-- Logs begin at Mon 2022-04-04 05:27:27 UTC, end at Mon 2022-04-04 06:35:18 UTC. -- Apr 04 05:55:34.566843 dv-cinder-834448-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 04 05:55:34.575938 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 4 05:55:34 2022] *** Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: nodename: dv-cinder-834448-2-iscsi Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: machine: x86_64 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: clock source: unix Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: pcre jit disabled Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: detected number of CPU cores: 4 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: current working directory: / Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: detected binary path: /usr/bin/uwsgi-core Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: your processes number limit is 47680 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: your memory page size is 4096 bytes Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: detected max file descriptor number: 2048 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: lock engine: pthread robust mutexes Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: thunder lock: enabled Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 04 05:55:34.581116 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 04 05:55:34.624949 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: Python main interpreter initialized at 0x55e6d91879c0 Apr 04 05:55:34.624949 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: python threads support enabled Apr 04 05:55:34.624949 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: your server socket listen backlog is limited to 100 connections Apr 04 05:55:34.624949 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: your mercy for graceful operations on workers is 90 seconds Apr 04 05:55:34.625306 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: mapped 403077 bytes (393 KB) for 2 cores Apr 04 05:55:34.625367 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: *** Operational MODE: preforking *** Apr 04 05:55:34.625687 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: *** uWSGI is running in multiple interpreter mode *** Apr 04 05:55:34.625687 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: spawned uWSGI master process (pid: 79952) Apr 04 05:55:34.625687 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: spawned uWSGI worker 1 (pid: 79967, cores: 1) Apr 04 05:55:34.625687 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: spawned uWSGI worker 2 (pid: 79968, cores: 1) Apr 04 05:55:34.625687 dv-cinder-834448-2-iscsi devstack@keystone.service[79952]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 04 05:55:34.625876 dv-cinder-834448-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 04 05:55:40.409757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 04 05:55:40.409757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: from cryptography.utils import int_from_bytes Apr 04 05:55:40.410607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 04 05:55:40.410607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: from cryptography.utils import int_from_bytes Apr 04 05:55:40.455613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 04 05:55:40.455801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 04 05:55:40.456008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] command line args: [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 04 05:55:40.456228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 04 05:55:40.456351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ================================================================================ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 04 05:55:40.457219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] admin_token = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.457219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config_dir = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.457219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.457219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config_source = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.457477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] debug = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.457541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.457864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.458192 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.458576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.458954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.459314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.459704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_config_append = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.460265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_dir = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.461949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.462171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.462411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.462638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.462862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.463238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.463460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.463846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.464094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.464361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.464876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.465027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] publish_errors = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.465253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.465605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.465909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.466179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.466390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.466604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] standard_threads = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.466963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.467336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.467639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.467850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_journal = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.468041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_json = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.468194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_stderr = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.468328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_syslog = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.468577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.468822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.469087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.469323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.469677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.470058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.470291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.470533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.470887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.471146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.471399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.471635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.472022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.472268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.472501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.472741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.473013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.473246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.473496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.473745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.473986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.474219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.474463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.474725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.474973 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.475275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.475504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.475733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.475943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.476271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.476522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.476766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.477032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.477261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.477503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.477746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.477977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.478220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.478448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.478678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.478908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.479135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.479360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.479588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.479813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.480046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.480290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.480516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.480747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.481019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.481248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.481480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.481725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.481950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.482182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.482413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.482646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.482876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.483108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.483335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.483581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.483814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.484047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.484275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.484546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.484767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.485015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.485251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.485484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.485753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.485989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.486232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.486476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.486707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.486937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.487165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.487407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.487638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.487869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.488106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.488338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.488568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.488796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.489073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.489280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.489538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.489770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.490004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.490235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.490470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.490758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.491174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.491501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.491734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.491964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.492187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.492420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.492645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.492882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.493131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.493378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.493610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.493864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.494119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.494355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.494583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.external = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.494809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.495097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.495325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.495549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.password = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.495775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.token = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.496008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.496226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.496469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.496693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.496967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.497213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.497441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.497669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.497910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.498159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.498402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.498633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.498872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.499102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.499363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.499610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.499843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.500098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.500373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.500615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.500871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.501144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.501410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.501624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.501854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.502093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.502334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.502558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.502798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.503030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.503276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.503506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.503756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.503995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.504227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.504458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.504698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.506286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.507690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.507690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.507690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.507690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.508441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.508441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.508441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.508441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.509150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.509150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.509539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.509539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.509873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.509873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.510201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.510389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.510611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.510775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.510960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.511153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.511364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.511615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.511844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.512081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.512323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.512545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.512774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.513020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.513262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.513496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.513737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.513968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.514198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.514441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.514688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.514914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.515138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.515381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.515622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.515852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.516081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.516310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.516534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.516768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.517064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.517293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.517536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.517773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.518014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.518241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.518464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.518700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.518929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.519159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.519384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.519622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.519861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.520099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.520337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.520574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.520797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.521070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.521310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.521540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.521771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.522260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.522634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.523076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.523830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.524102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 04 05:55:40.524102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: from cryptography.utils import int_from_bytes Apr 04 05:55:40.524952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.525121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 04 05:55:40.525121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: from cryptography.utils import int_from_bytes Apr 04 05:55:40.525363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.525363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.525363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.525736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.525873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.526067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.526311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.526552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.526767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.527005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.527253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.527499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.527732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.527976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.528225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.528454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.528697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.528980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.529175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.529399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.529643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.529868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.530110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.530355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.530598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.530839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.531081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.531327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.531566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.531808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.532033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.532274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.532516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.532757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.533021 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.533458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.533692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.533934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.534179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.534421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.534666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.534896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.535147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.535393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.535627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.535853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.536078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.536303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.536548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.536798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.537064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.537298 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.537528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.537979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.538313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.538590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.538837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.539072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.539324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.539568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.539810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.540050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.540287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.540529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.540761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.541014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.541244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.541487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.541730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.541952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.542190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.542477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.542732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.542969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.543209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.543439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.543673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.543901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.544129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.544357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.544586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.544824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.545078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.545317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.545548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.545788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.546016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.546261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.546484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.546718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.546946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.547112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 04 05:55:40.569095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 04 05:55:40.569322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 04 05:55:40.569652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] command line args: [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 04 05:55:40.570117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 04 05:55:40.570327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ================================================================================ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 04 05:55:40.570599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] admin_token = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.570849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config_dir = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.571041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.571223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config_source = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.571409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] debug = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.571623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.571858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.572037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.572290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.572533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.572760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.572974 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_config_append = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.573136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.573301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_dir = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.573475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.573708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.573954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.574198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.574443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.574618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.574793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.575035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.575276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.575504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.575732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.575962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.576189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.576437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.576679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.576983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.577496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.577674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] publish_errors = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.577905 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.578128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.578302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.578542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.578773 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.579009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] standard_threads = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.579235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.579401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.579530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.579652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.579775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.579775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_journal = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.580012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_json = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.580133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.580260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_stderr = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.580260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_syslog = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.580492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 04 05:55:40.580729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.580998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.581258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.581497 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.581744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.581980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.582225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.582456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.582701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.582943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.583195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.583427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.583672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.583906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.584150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.584474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.584717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.585133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.585539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.585957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.586201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.586458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.586725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.586980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.587230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.587462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.587692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.587922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.588157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.588406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.588652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.588786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.588940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.589132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.589378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.589623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.589858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.590107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.590338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.590572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.590807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.591037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.591267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.591497 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.591725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.591960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.592209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.592436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.592670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.592969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.593176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.593414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.593658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.593885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.594121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.594837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.594837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.594837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.595047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.595277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.595525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.595759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.595993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.596232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.596485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.596722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.596974 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.600933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.601874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.602212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.602351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.602585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.602826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.603063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.603297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.603537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.603762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.603990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.604218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.604450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.604678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.604944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.605172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.605418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.605652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.605908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.606165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.606403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.606632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.external = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.606862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.607151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.607381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.607609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.password = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.607836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.token = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.608073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.608305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.608549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.608775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.609104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.609352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.609580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.609821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.610058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.610306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.610552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.610785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.611030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.611264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.611527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.611778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.612020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.612272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.612559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.612807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.613098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.613339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.613595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.613830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.614066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.614311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.614556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.614784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.615034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.615268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.615519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.615900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.616320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.616681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.616961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.617195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.617445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.617692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.617929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.618164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.618413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.618641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.618877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.619129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.619268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.619403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.619532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.619659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.619814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.620040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.620282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.620526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.620769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.621045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.621298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.621569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.621877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.622025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.622257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.622490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.622718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.622950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.623186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.623421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.623664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.623891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.624238 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.624493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.624726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.624990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.625236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.625527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.625763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.625993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.626228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.626461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.626716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.626940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.627176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.627422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.627673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.627904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.628131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.628377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.628621 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.628853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.629116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.629349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.629576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.629811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.630067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.630296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.630539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.630782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.631025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.631334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.631603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.632028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.632353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.632593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.632826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.633099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.633346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.633589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.633835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.634079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.634308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.634552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.634787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.635019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.635253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.635486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.635728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.635972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.636206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.636457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.636686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.636951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.637188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.637423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.637657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.637903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.638144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.638372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.638616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.638855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.639110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.639358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.639595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.639843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.640092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.640328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.640574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.640809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.641071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.641305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.641553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.641781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.642029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.642277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.642523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.642768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.643018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.643263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.643507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.643752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.643981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.644225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.644469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.644713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.644977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.645407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.645644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.645893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.646143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.646391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.646641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.646931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.647248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.647708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.647960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.648194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.648805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.649071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.649321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.649579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.649830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.650067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.650304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.650532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.650766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.651000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.651247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.651483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.651737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.651982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.652217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.652460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.652702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.653046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.653196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.653442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.653671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.653915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.654161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.654388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.654631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.654947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.655206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.655449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.655696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.655932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.656171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.656405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.656639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.656872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.657146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.657391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.657626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.657868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.658104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.658349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.658580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.658820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.659053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.659292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.659524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 04 05:55:40.659690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 04 05:55:40.675135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.687124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.687386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.687644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.696935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.715703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.715941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.725243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.725485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.755530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.791666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.791967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.792109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.792359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.792575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.792732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.792870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.793030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.818714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.819035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.819394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.819585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.819915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.820061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.820204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.831782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.836712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.836942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.837179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.837369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.837574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.837807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.845745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.845899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.846055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.846192 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.846432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.846624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.846845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.853226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.853441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.853660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.853851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.854070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.854261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.854451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.862455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.864502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.864698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 04 05:55:40.865063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.865271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 04 05:55:40.865517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.865806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.866006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.866221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.866443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.866615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.866748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.866748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.867007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.867133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.867269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 04 05:55:40.877082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.877362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.877554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.877696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.877845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 04 05:55:40.877977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.878107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.878249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 04 05:55:40.878684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.878949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.879188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.879461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.886114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.889370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.889653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.889901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.890199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.890390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.890546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.890680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.890810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.890951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.891084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.891213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.891341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.891470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.891727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.891993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.900092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.903368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.903644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.903928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.904209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.904520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.904794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.905092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.905368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.905618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.905900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.906176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.919099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.920704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.920992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.926267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.926604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.926884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.933187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.934173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.934457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.934795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.935047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.938942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.939233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.939521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.939802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.940079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.940271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.940415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.940561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.940694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.940824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.940995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.948549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.948841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.953287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.953571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.953856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.954145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.954393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.954690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.954956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.955198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.959559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.959867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.964410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.968073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.968481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.973463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.974426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.974711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.977093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.979624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.980659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.980983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.981267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.981553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.981837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.982115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.983224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.983556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.988558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.992572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:40.996143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.996445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.996733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.997046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.997322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:40.997602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.001679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.002032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.002302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.002539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.010515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.012185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.012439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.015598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.015888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.016174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.016447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.016728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.016965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.017119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.017394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.017627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.027656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.029933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.030368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.030566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.030820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.031099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.031351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.033147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.033451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.033764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.033930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.034085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.034222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.034503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.034780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.050408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.050651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.050957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.051234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.051606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.051802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.051950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.052132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.055041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.058350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.070938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.074357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.077963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.081447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.083328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.083663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.083853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.092203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.093882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.097174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.097459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.169495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.171167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.171425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.171737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.179415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.180966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.184495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.184785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.185082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.185359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.194819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.195143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.195400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.203349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.203634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.204018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.204236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.204386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.204545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.204683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.204816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.205103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.205345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.205642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.205890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.206180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.206457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.206667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.206943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.214140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.214426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.214682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.222494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 04 05:55:41.223005 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.223204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.223464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.223740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.223971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.224371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.224590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.224739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.225187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.225575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.226031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.226307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.226591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 04 05:55:41.244957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e6d91879c0 pid: 79968 (default app) Apr 04 05:55:41.248511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9414a-b43c-4de5-8794-c4237e4de34d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:41.248808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9414a-b43c-4de5-8794-c4237e4de34d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:41.249059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9414a-b43c-4de5-8794-c4237e4de34d None None] PATH_INFO: `/v3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:41.255600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Mon Apr 4 05:55:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:41.264532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e6d91879c0 pid: 79967 (default app) Apr 04 05:55:49.510119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc424-129b-43ab-8621-1f90e79f52c5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:49.510714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc424-129b-43ab-8621-1f90e79f52c5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:49.510714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc424-129b-43ab-8621-1f90e79f52c5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:49.512750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:55:49.523703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:49.524651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:49.524762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:49.560517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG oslo_db.sqlalchemy.engines [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 04 05:55:49.750319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG passlib.handlers.bcrypt [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79967) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 04 05:55:49.750731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG passlib.handlers.bcrypt [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79967) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 04 05:55:49.806784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:49.808385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:49.942720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 04 05:55:50.089793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc424-129b-43ab-8621-1f90e79f52c5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:50.135310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG oslo_db.sqlalchemy.engines [None req-5b5fc424-129b-43ab-8621-1f90e79f52c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 04 05:55:50.274367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc424-129b-43ab-8621-1f90e79f52c5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:50.279800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:50.280453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:50.280734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:50.281039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:50.290316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:50.340471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 04 05:55:50.340737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fd2df-9774-4fce-8fc8-3aaf242fdfeb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:50.350552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1324 bytes} [Mon Apr 4 05:55:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 05:55:50.357986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:50.381840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d4e5e-ff27-4064-9b5a-99939e8775dc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:50.386617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:50.387768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:50.388053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:50.388328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] PATH_INFO: `/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:50.390013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] RBAC: Authorizing `identity:get_project(project_id=f13bc56bb56c4dff9db8451a514a4fb8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:50.443091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 04 05:55:50.443481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf5a8-1dd4-4810-9b41-2dae325a222a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:50.448466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 2/5] 10.222.0.30 () {56 vars in 1207 bytes} [Mon Apr 4 05:55:50 2022] GET /identity/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:52.705693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3e7df-4b3c-435f-bde6-b4358286f747 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:52.706522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3e7df-4b3c-435f-bde6-b4358286f747 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:52.706522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3e7df-4b3c-435f-bde6-b4358286f747 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:52.714335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 4/6] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:52.719934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:52.720382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:52.720466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:52.740020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:52.741580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:52.749977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 04 05:55:52.772870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3e7df-4b3c-435f-bde6-b4358286f747 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:52.796432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3e7df-4b3c-435f-bde6-b4358286f747 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:52.804750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1388f-fe7c-4448-bad7-babe16529e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:52.805426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1388f-fe7c-4448-bad7-babe16529e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:52.806745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1388f-fe7c-4448-bad7-babe16529e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:52.806745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1388f-fe7c-4448-bad7-babe16529e9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:52.814825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1388f-fe7c-4448-bad7-babe16529e9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:52.816628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1388f-fe7c-4448-bad7-babe16529e9e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:52.825814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1324 bytes} [Mon Apr 4 05:55:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 05:55:52.832247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:52.842668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb5224-63e6-4aca-a813-415fd19b70be None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:52.848390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2316dd7-4753-4665-89d3-7da2d787d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:52.849299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316dd7-4753-4665-89d3-7da2d787d04d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:52.849570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316dd7-4753-4665-89d3-7da2d787d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:52.849991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2316dd7-4753-4665-89d3-7da2d787d04d admin admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:52.851491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2316dd7-4753-4665-89d3-7da2d787d04d admin admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:52.853371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2316dd7-4753-4665-89d3-7da2d787d04d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:52.854957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 4/9] 10.222.0.30 () {56 vars in 1198 bytes} [Mon Apr 4 05:55:52 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:55.191948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e736-7c28-4073-8176-bfb86b95f248 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.192462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e736-7c28-4073-8176-bfb86b95f248 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.192462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e736-7c28-4073-8176-bfb86b95f248 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.194425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:55.199862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.200276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.200499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.218420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:55.219626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:55.275250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618901-4374-4f60-8390-980deda36fda None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.275499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618901-4374-4f60-8390-980deda36fda None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.275800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618901-4374-4f60-8390-980deda36fda None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.277744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 7/11] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:55.282658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.283101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.283524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.305846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 5/12] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:55:55.326315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG passlib.handlers.bcrypt [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79968) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 04 05:55:55.326719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG passlib.handlers.bcrypt [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79968) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 04 05:55:55.329117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.372754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:55.374399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:55.430876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fbd26-ec3f-4a90-9c46-ef3857278c14 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:55.464928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:55.465679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.465959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.466233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.472176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 8/13] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:55:55.477396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:55:55.484335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:55:55.485613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 6/14] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:55:55.491537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.494910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.595643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543f7d3-1646-43ca-8325-4f8e9483d1a2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:55.597383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db435d-0e84-497f-856a-c23ec3088ffb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:55.631166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:55.631808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.632036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:55.632138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.632341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.632980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.633274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.633551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.634471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:55:55.634770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:55.636218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:55.647989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 9/15] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:55:55.653879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.702367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:55.703843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:55.749330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4ac5-9d42-41e9-9160-b32fb0e0d9f3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:55.783246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:55.784137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.784417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.784682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.786356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:55.787837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:55.789477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 10/16] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:55:55.795130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.801846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 7/17] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:55:55.807795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.899525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1b87a-d348-4357-a8b4-d40e50af9072 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:55.909289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9f98-0df3-4407-a368-aee05fbea813 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:55.932445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:55.933269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.933548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.933811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.934998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:55.936452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:55.938081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 11/18] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:55:55.942458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:55.943261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:55.943534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:55.943720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:55.943806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:55.954134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:55.955680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:55.972655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:55:55.973859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 8/19] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:55:55.979487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:56.036763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7c55-9f06-4703-8b05-d6c3fd84512e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:56.069718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:56.070368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:56.070646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:56.070903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:56.071723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.domain.id=default, user.id=0d8085b78f244bdfbf8da4f7668ae4fd) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:55:56.072024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:56.073579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5eeaf-df10-44fa-a87a-242291eb522e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:56.075862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd827e-a6d5-4d02-8fd9-977b70402e40 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:56.082024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 12/20] 10.222.0.30 () {56 vars in 1322 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/role_assignments?user.id=0d8085b78f244bdfbf8da4f7668ae4fd&scope.domain.id=default&role.id=5fd8ee302a3344489bda8c045d41beba => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:56.110397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:56.111083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:56.111363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:56.111640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:56.112404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:55:56.112703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:56.114222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68739f-dda1-4c4b-baa7-13d141a76c27 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:56.133738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 9/21] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:58.855861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6cf47-d3d5-4e4c-8eaf-848c673a3aff None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:58.856819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6cf47-d3d5-4e4c-8eaf-848c673a3aff None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:58.857334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6cf47-d3d5-4e4c-8eaf-848c673a3aff None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:58.859783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 13/22] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:58.865712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:58.866745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:58.867217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:58.885251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:58.886809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:58.974579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 10/23] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:55:58.998162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0778b0-e79f-4e87-82b6-321ec16485f4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:58.998808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0778b0-e79f-4e87-82b6-321ec16485f4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:58.999083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0778b0-e79f-4e87-82b6-321ec16485f4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.000082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.001673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 14/24] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:59.007405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.007949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.008519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.027005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:59.028498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:59.099322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed895a0-5dc5-4d88-b5de-da5c583d49ee None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.133020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 15/25] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:55:59.145856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2436e9-d104-4d9e-b825-80d215f205f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.146782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2436e9-d104-4d9e-b825-80d215f205f9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.147132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2436e9-d104-4d9e-b825-80d215f205f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.147486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2436e9-d104-4d9e-b825-80d215f205f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.160383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.165003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2436e9-d104-4d9e-b825-80d215f205f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:55:59.171442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-3b2436e9-d104-4d9e-b825-80d215f205f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:55:59.176322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 11/26] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:55:59.177825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee66e-7d85-4058-91cc-f57cba1c498a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.178240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee66e-7d85-4058-91cc-f57cba1c498a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.178520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee66e-7d85-4058-91cc-f57cba1c498a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.180850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 12/27] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:59.181653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee66e-7d85-4058-91cc-f57cba1c498a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.294185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee66e-7d85-4058-91cc-f57cba1c498a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.304009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50396c1a-358d-43f9-b7d7-d2193ae9999c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.330080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.330750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.331187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.331610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.332498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:55:59.332965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:59.335070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7f715-5ed7-48f9-b440-2342fb41639e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:59.338789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.339754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.340197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.340602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.353115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 13/28] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:55:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:59.354560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.354955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.355319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.366970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:59.368683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:59.374257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:59.375699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:59.397587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:55:59.405359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 16/29] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:55:59.406213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.450350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 14/30] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:55:59.451529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.564284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19fb95-a9e0-45a5-b687-3aecb1413215 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.574301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8dd0-393b-46a2-ae3a-93444c390081 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.597689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec8a4a-99fc-4548-8e62-08fb4c9af801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.598575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8a4a-99fc-4548-8e62-08fb4c9af801 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.598855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8a4a-99fc-4548-8e62-08fb4c9af801 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.599129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec8a4a-99fc-4548-8e62-08fb4c9af801 None admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.600383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec8a4a-99fc-4548-8e62-08fb4c9af801 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:59.601867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec8a4a-99fc-4548-8e62-08fb4c9af801 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:59.604139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 17/31] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:55:59 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:59.605632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504798ad-fb43-47c1-8585-62faed759cb2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.606054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504798ad-fb43-47c1-8585-62faed759cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.606464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504798ad-fb43-47c1-8585-62faed759cb2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.611771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.612360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 18/32] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:55:59.612962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.613164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504798ad-fb43-47c1-8585-62faed759cb2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.613991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.614456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.616116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:55:59.616619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:59.618251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:59.636931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 15/33] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:59.636931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.739897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504798ad-fb43-47c1-8585-62faed759cb2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.762756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e981-3924-472a-b6c0-d090298c6b38 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:55:59.776304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.777305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.777840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.778304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.779241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:59.780819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:59.800210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63c557-6d3d-463d-844d-c5b0c2a2d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:55:59.801373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c557-6d3d-463d-844d-c5b0c2a2d63c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.801792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c557-6d3d-463d-844d-c5b0c2a2d63c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.802202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c557-6d3d-463d-844d-c5b0c2a2d63c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.803799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63c557-6d3d-463d-844d-c5b0c2a2d63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:55:59.805490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63c557-6d3d-463d-844d-c5b0c2a2d63c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:55:59.807644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 16/34] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:55:59.809001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:55:59.809411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:55:59.809842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:55:59.835592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:55:59.837093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:55:59.909751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 17/35] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:55:59.910702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:55:59.915211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 19/36] 10.222.0.30 () {60 vars in 1131 bytes} [Mon Apr 4 05:55:59 2022] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:55:59.922117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:00.046509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af51db-63c2-4fa6-b2a5-20649660d57b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:00.087005 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:00.087688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.087970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.088244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.088991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:00.090528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:00.191273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce0713-b41d-4cb8-abc7-52bbcfee94e2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:00.229891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872267-1884-42ad-969e-75f87d58a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:00.231803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872267-1884-42ad-969e-75f87d58a1b9 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.232327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872267-1884-42ad-969e-75f87d58a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.232811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872267-1884-42ad-969e-75f87d58a1b9 None admin] PATH_INFO: `/v3/domains/default/users/0d8085b78f244bdfbf8da4f7668ae4fd/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.235344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872267-1884-42ad-969e-75f87d58a1b9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0d8085b78f244bdfbf8da4f7668ae4fd, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:00.237218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872267-1884-42ad-969e-75f87d58a1b9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:00.258370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:55:59 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:00.258555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 20/38] 10.222.0.30 () {58 vars in 1361 bytes} [Mon Apr 4 05:55:59 2022] PUT /identity/v3/domains/default/users/0d8085b78f244bdfbf8da4f7668ae4fd/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:00.259488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:00.375383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048cade-3157-41d8-9b45-876c2b635e90 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:00.421849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf94a67-519c-4da2-b072-322d1412dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:00.422617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf94a67-519c-4da2-b072-322d1412dad8 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.422905 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf94a67-519c-4da2-b072-322d1412dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.423182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf94a67-519c-4da2-b072-322d1412dad8 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.424024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf94a67-519c-4da2-b072-322d1412dad8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:00.425813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf94a67-519c-4da2-b072-322d1412dad8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:00.455892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1131 bytes} [Mon Apr 4 05:56:00 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:00.526164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207a800-cb59-4c38-a363-e91ba4e7bf30 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.526801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207a800-cb59-4c38-a363-e91ba4e7bf30 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.527090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207a800-cb59-4c38-a363-e91ba4e7bf30 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.529462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 21/40] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:00.535998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11971-3712-4f7b-9fcd-bdd0b01eed86 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.536321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11971-3712-4f7b-9fcd-bdd0b01eed86 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.536614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11971-3712-4f7b-9fcd-bdd0b01eed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.558538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0dc11971-3712-4f7b-9fcd-bdd0b01eed86 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:00.560160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0dc11971-3712-4f7b-9fcd-bdd0b01eed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:00.650058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 20/41] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:00.655826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c3933-ddc6-404f-9b51-7e006aa089ec None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.656139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c3933-ddc6-404f-9b51-7e006aa089ec None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.656416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c3933-ddc6-404f-9b51-7e006aa089ec None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.658245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 22/42] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:00.664319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.664653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.665010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.677177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c3933-ddc6-404f-9b51-7e006aa089ec None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:00.684861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:00.686488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:00.767874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:00.792050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:00.801480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c3933-ddc6-404f-9b51-7e006aa089ec None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:00.851719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:00.852333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.852623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.852988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.854175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:00.855687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:00.859152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 23/44] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:00.862945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:00.909220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c70fdd-f0df-4883-b6ce-a3805942344c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:00.941927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7bdc0-3c9d-49a7-bb14-22d53f5d8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:00.942688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7bdc0-3c9d-49a7-bb14-22d53f5d8b0e None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:00.942883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7bdc0-3c9d-49a7-bb14-22d53f5d8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:00.943303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7bdc0-3c9d-49a7-bb14-22d53f5d8b0e None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:00.944264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7bdc0-3c9d-49a7-bb14-22d53f5d8b0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:00.945744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7bdc0-3c9d-49a7-bb14-22d53f5d8b0e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:00.958532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1131 bytes} [Mon Apr 4 05:56:00 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:00.964744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957c8f-846c-4bf1-a5d8-b210cc998e1f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:01.000783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a72a-2151-4702-8e57-7865b1bea9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:01.001489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a72a-2151-4702-8e57-7865b1bea9cd None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:01.001771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a72a-2151-4702-8e57-7865b1bea9cd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:01.002044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a72a-2151-4702-8e57-7865b1bea9cd None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:01.002773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8a72a-2151-4702-8e57-7865b1bea9cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:01.004240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8a72a-2151-4702-8e57-7865b1bea9cd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:01.037047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:56:00 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:02.831977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697e411-8d84-4a86-95f2-86cbb55fd6cb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:02.832557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697e411-8d84-4a86-95f2-86cbb55fd6cb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:02.832557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697e411-8d84-4a86-95f2-86cbb55fd6cb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:02.834513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 23/47] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:02.839905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:02.840320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:02.840499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:02.858461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:02.859988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:02.930189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 25/48] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:02.953781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697e411-8d84-4a86-95f2-86cbb55fd6cb None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.064012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697e411-8d84-4a86-95f2-86cbb55fd6cb None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.098200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.098932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.099284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.099658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.109725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:03.117114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:03.118328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 24/49] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:03.124260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.226755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb5178-e131-41e8-b853-1cf1afa52676 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.261716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.262388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.262667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.262938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.263689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:03.263986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:03.265418 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24c2f8-a9c3-4f2b-9734-a0497afa4ce5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:03.274134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 26/50] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:03.279849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.331388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365bd8-df55-46bb-b369-621f5b372c3e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.331625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365bd8-df55-46bb-b369-621f5b372c3e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.331923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78365bd8-df55-46bb-b369-621f5b372c3e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.333843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 27/51] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:03.339112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.339397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.339671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.357032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:03.358193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:03.379768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e964b58-4515-46d4-a6ff-2bf9bf95a01a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.414990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.415871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.416153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.416435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.417649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:03.419110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:03.420797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 25/52] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:03 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:03.426438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.430634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 28/53] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:03.454368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.519207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52a58c-2a5f-4ace-af13-46614dac9829 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.550972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66a9b7-02ef-475e-92cb-96cce4b2b73c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.554339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.555143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.555428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.555699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.557034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:03.558550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:03.560175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 26/54] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:03.565988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.586840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.587654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.587994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.588307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.589645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:03.591196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:03.592948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 29/55] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:03.599254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:03.671149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eeb832-be9d-448b-8ed1-da53d3470a63 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.696407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ccb49-15b3-49bd-9e94-11ef395e6c91 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:03.705252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.705912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.706196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.706472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.707315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.domain.id=default, user.id=0d8085b78f244bdfbf8da4f7668ae4fd) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:03.707623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:03.709297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40711-3591-41be-8ec5-251b831795b0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:03.716830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 27/56] 10.222.0.30 () {56 vars in 1322 bytes} [Mon Apr 4 05:56:03 2022] GET /identity/v3/role_assignments?user.id=0d8085b78f244bdfbf8da4f7668ae4fd&scope.domain.id=default&role.id=5fd8ee302a3344489bda8c045d41beba => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:03.734576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b600f81-239f-4b1b-b273-53d808c74f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:03.735265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600f81-239f-4b1b-b273-53d808c74f0d None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:03.735529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600f81-239f-4b1b-b273-53d808c74f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:03.735804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b600f81-239f-4b1b-b273-53d808c74f0d None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:03.736537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b600f81-239f-4b1b-b273-53d808c74f0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:03.738078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b600f81-239f-4b1b-b273-53d808c74f0d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:03.767437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 30/57] 10.222.0.30 () {60 vars in 1140 bytes} [Mon Apr 4 05:56:03 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:56:06.065498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513751d-f22c-4a14-bbf3-50aee561d087 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:06.066037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513751d-f22c-4a14-bbf3-50aee561d087 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:06.066037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513751d-f22c-4a14-bbf3-50aee561d087 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:06.067872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 28/58] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:06.074512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:06.075228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:06.075369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:06.103550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:06.104695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:06.183535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 31/59] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:06.212522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513751d-f22c-4a14-bbf3-50aee561d087 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:06.323176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513751d-f22c-4a14-bbf3-50aee561d087 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:06.356869 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35b4bc-4546-40ab-a170-9aba68481dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:06.357616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b4bc-4546-40ab-a170-9aba68481dc9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:06.357893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b4bc-4546-40ab-a170-9aba68481dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:06.358162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35b4bc-4546-40ab-a170-9aba68481dc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:06.359459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b4bc-4546-40ab-a170-9aba68481dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:06.360942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35b4bc-4546-40ab-a170-9aba68481dc9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:06.362504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 29/60] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:06.371575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:06.470303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d974a8b-2572-4e41-b900-90c52a4ad82d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:06.507808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69882-7001-4fb1-9512-7018f5b3e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:06.508460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69882-7001-4fb1-9512-7018f5b3e988 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:06.508696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69882-7001-4fb1-9512-7018f5b3e988 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:06.509034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69882-7001-4fb1-9512-7018f5b3e988 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:06.509750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69882-7001-4fb1-9512-7018f5b3e988 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:06.511191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69882-7001-4fb1-9512-7018f5b3e988 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:06.539035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 32/61] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:06 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:10.081605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182111-4f32-4a3a-87c6-d36404490f80 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.081605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182111-4f32-4a3a-87c6-d36404490f80 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.081605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182111-4f32-4a3a-87c6-d36404490f80 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.081605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 30/62] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:10.087303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb93ac-9a24-4edd-b821-ee6f69bc40b5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.087721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb93ac-9a24-4edd-b821-ee6f69bc40b5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.087856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb93ac-9a24-4edd-b821-ee6f69bc40b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.110697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d7fb93ac-9a24-4edd-b821-ee6f69bc40b5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:10.112089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d7fb93ac-9a24-4edd-b821-ee6f69bc40b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:10.199724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:10.235155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33182111-4f32-4a3a-87c6-d36404490f80 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.270658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0316-ebb6-4f4d-8bfe-59cc09b2900e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.271316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0316-ebb6-4f4d-8bfe-59cc09b2900e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.271774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d0316-ebb6-4f4d-8bfe-59cc09b2900e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.274241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 34/64] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:10.287663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96329a-b74e-4cf8-9a4e-f13e76da61fa None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.288276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96329a-b74e-4cf8-9a4e-f13e76da61fa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.288752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96329a-b74e-4cf8-9a4e-f13e76da61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.311641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ec96329a-b74e-4cf8-9a4e-f13e76da61fa None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:10.313208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ec96329a-b74e-4cf8-9a4e-f13e76da61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:10.360546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33182111-4f32-4a3a-87c6-d36404490f80 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.384197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 35/65] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:10.393302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6272493-207e-48a5-8cda-27bb8b034c0a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.393615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6272493-207e-48a5-8cda-27bb8b034c0a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.393845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6272493-207e-48a5-8cda-27bb8b034c0a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.395629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 36/66] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:10.402678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000470f-83d4-45fd-9fdf-6c670b6f8c14 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.403206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000470f-83d4-45fd-9fdf-6c670b6f8c14 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.403697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000470f-83d4-45fd-9fdf-6c670b6f8c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.410177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.410993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.411271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.411542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.424942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:10.427135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1000470f-83d4-45fd-9fdf-6c670b6f8c14 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:10.428447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1000470f-83d4-45fd-9fdf-6c670b6f8c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:10.432177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:10.433592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 31/67] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:10.434240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.495604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 37/68] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:10.503278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2868-09ce-4195-9a2e-7b25a7b0a5fa None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.503566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2868-09ce-4195-9a2e-7b25a7b0a5fa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.503832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2868-09ce-4195-9a2e-7b25a7b0a5fa None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.505773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 38/69] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:10.507015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2868-09ce-4195-9a2e-7b25a7b0a5fa None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.538165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ebbd8-4266-4c4d-ab4f-efcc1f8d6345 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.570069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6466419-bd61-430b-b66d-9fecd2cfaa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.570915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466419-bd61-430b-b66d-9fecd2cfaa96 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.571223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466419-bd61-430b-b66d-9fecd2cfaa96 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.571471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6466419-bd61-430b-b66d-9fecd2cfaa96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.581954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6466419-bd61-430b-b66d-9fecd2cfaa96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:10.588835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-c6466419-bd61-430b-b66d-9fecd2cfaa96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:10.590288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 32/70] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:10.591280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.591555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.591827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.610554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:10.611748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:10.615883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2868-09ce-4195-9a2e-7b25a7b0a5fa None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.649865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.650459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.650741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.651018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.651864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:10.652177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:10.653747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:10.666325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 39/71] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:10.667420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.680335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 33/72] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:10.681308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.774000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a2d1c-8d60-47ed-9d58-963d893514eb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.782706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87d1d-f07a-4859-a486-96bfd5105818 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.806202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.807030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.807309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.807570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.815962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.816636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.816932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.817210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.817955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:10.818256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:10.819088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:10.819640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:10.826816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:10.833140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 34/73] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:10.833291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 40/74] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:10.833376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.833478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.923990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59742fa-5fd1-4946-b619-48ef7dc57efe None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.927575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e136-67bb-444b-b811-ede148877f8e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:10.957300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5993-a331-43b1-a28b-440a136d120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.958091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5993-a331-43b1-a28b-440a136d120d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.958368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5993-a331-43b1-a28b-440a136d120d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.958637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5993-a331-43b1-a28b-440a136d120d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.961299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:10.962183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.962465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.962739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.968200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f5993-a331-43b1-a28b-440a136d120d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:10.975134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-b49f5993-a331-43b1-a28b-440a136d120d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:10.976427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 41/75] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:10.981577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:10.981682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a570-ee13-491a-b133-ddf6e6610a52 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:10.981682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a570-ee13-491a-b133-ddf6e6610a52 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:10.981682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a570-ee13-491a-b133-ddf6e6610a52 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:10.981873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:10.981873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 35/76] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:10.981873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:10.984479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 42/77] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:10.985107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a570-ee13-491a-b133-ddf6e6610a52 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.079732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97933-c0ee-4fa1-8ca2-b31e529c621e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.082789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a570-ee13-491a-b133-ddf6e6610a52 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.112616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.113517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.113800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.114075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.115284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.116887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.118531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 36/78] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.118859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.119333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.119501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.119800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.120073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.120821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:11.121159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.122529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c6868-5881-4d5f-84e3-e46c93785725 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.130766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 43/79] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.131956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.132229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.132499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.149104 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:11.150283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:11.220125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 44/80] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:11.220125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.225929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920be875-d8c8-4fe2-8cef-99b4bca56f54 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.264422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.265123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.265398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.265667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.266416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:11.266715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.268089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.276767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 37/81] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.277504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.316692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441eaaf-a1c6-4608-b036-a11444fe187f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.350499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.351113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.351424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.351677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.370899 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd04f-f44e-4b40-8c2d-6c78eedcc183 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.402625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.403274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.403552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.403824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.415830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.417368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.469076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.470573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.513714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 45/82] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:11.514544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.571295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 38/83] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:11.572208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.608116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88254b7b-4767-4bd6-adb5-32bffc0781f7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.641488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.642364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.642645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.642918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.644129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.645626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.648320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 46/84] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.648757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.669992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8861b2f-7d60-48d1-8021-4ff2cc822066 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.704365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.705181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.705460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.705733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.706908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.708375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.714889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 39/85] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.714889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.745608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fae90-6cbb-4342-a337-825b08a248a0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.777683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.778564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.778839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.779108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.780296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.781773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.783380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 47/86] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.784147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.811903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e1b38-af5b-44e5-8140-4b633960dba4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.844928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.845807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.846088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.846358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.847521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.849003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.850707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 40/87] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.851456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.882836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b6d4-8f89-474e-9c1e-683715a65548 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.918405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.919267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.919546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.919819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:11.921094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:11.922535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:11.924239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 48/88] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:11.924990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:11.954406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeb114-5bf4-4dc0-b112-a12a8b8b4ee6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:11.987011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:11.987665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:11.987945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:11.988223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.018799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4290c-52a7-4052-ab85-d98d86f20622 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.051901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.052400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.052586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.052840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.053246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.053909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.054161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.055589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.075485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 49/89] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:11 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:12.076291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.162140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 41/90] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:12.162140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.183860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4391d4-f81f-4368-85c6-c2a615021026 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.218254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.218921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.219199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.219464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.262505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc54e2e-552a-4212-b31c-975fb6e626b7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.289908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.291302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.302284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.302658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.303631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.303631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.304139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=664039323cb74005a11f2571bdf1b455) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:12.304443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.306029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.314033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 42/91] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/role_assignments?user.id=664039323cb74005a11f2571bdf1b455&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:12.314033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.405010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 50/92] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:12.408990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.451762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2313e9-65c5-4926-85b9-0678450da8e7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.491889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.492565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.492841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.493156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.494006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=0d8085b78f244bdfbf8da4f7668ae4fd) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:12.494316 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.495809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.503514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 43/93] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/role_assignments?user.id=0d8085b78f244bdfbf8da4f7668ae4fd&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:12.504384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.533226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83ed3-3915-4b45-97dd-99912ab01df7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.572800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.573720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.573999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.574269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.575497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.576992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.579017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 51/94] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:12.585048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.642963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0876f-f57f-4f9d-b8fa-28886b8fef7f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.679016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.679892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.680178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.680458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] PATH_INFO: `/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.681723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] RBAC: Authorizing `identity:get_project(project_id=6c776cbb7a3347a4ba95a7b0e10950cd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.683213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.685337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 44/95] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:12.689264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecda32-38c6-4d9f-b591-890076be991a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.691229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:12.726387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.727870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.728148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.728415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.729302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] RBAC: Adding query filter params (role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=664039323cb74005a11f2571bdf1b455) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:12.729611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.731128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cf6c9-5e4d-46e4-bf57-dd7bdc80a6e4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.738689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 52/96] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/role_assignments?user.id=664039323cb74005a11f2571bdf1b455&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:12.804867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079a2c5-b29e-42da-a06a-66d73d37c43f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:12.846136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:12.847188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:12.847188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:12.847330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:12.852933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=6c776cbb7a3347a4ba95a7b0e10950cd, user.id=664039323cb74005a11f2571bdf1b455) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:12.852933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:12.852933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71309e9f-492d-4660-a327-fe0adc0d1932 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:12.856837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 45/97] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:12 2022] GET /identity/v3/role_assignments?user.id=664039323cb74005a11f2571bdf1b455&scope.project.id=6c776cbb7a3347a4ba95a7b0e10950cd&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:15.493822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f57a-b0e0-4bef-88a5-81c1e4106088 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:15.494404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f57a-b0e0-4bef-88a5-81c1e4106088 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:15.494404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f57a-b0e0-4bef-88a5-81c1e4106088 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:15.496145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 53/98] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:15.501715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:15.502151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:15.502326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:15.526108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:15.527345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:15.583142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092200-7b31-40ff-ae96-a3854c6b84bd None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:15.583469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092200-7b31-40ff-ae96-a3854c6b84bd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:15.583697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092200-7b31-40ff-ae96-a3854c6b84bd None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:15.585710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 54/99] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:15.597946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:15.598248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:15.598480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:15.611144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 46/100] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:15.642240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:15.643469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:15.648217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:15.735240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 55/101] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:15.775646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:15.910907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288cfbf-7db4-4987-9b50-dadcb08ddde3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:15.928570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f4d65-61fe-4f9a-84f2-260408b142c8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:15.994402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:15.995218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:15.995498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:15.995763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.028446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.029329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.029619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.029717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:16.029897 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.031190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:16.033792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:16.035747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 47/102] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:16.040030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:16.041240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.049920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 56/103] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:16.055914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.153042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182fa80-bf63-49a4-b593-68dee70d0685 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.187786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b708d-28be-4087-86d4-f7dc42f69b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.188646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b708d-28be-4087-86d4-f7dc42f69b9a None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.188943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b708d-28be-4087-86d4-f7dc42f69b9a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.189227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b708d-28be-4087-86d4-f7dc42f69b9a None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.189955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b708d-28be-4087-86d4-f7dc42f69b9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:16.191454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b708d-28be-4087-86d4-f7dc42f69b9a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:16.192878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beec82-8a25-4a8b-9824-acdfd0aeb2b7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 48/104] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:56:16 2022] POST /identity/v3/projects => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd98ac-ca2d-4cb4-b614-100e7ebab466 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd98ac-ca2d-4cb4-b614-100e7ebab466 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd98ac-ca2d-4cb4-b614-100e7ebab466 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 49/105] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29b0e-d0a1-4f71-9fe7-1eb96275e162 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.218384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29b0e-d0a1-4f71-9fe7-1eb96275e162 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.227256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc29b0e-d0a1-4f71-9fe7-1eb96275e162 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.227256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 50/106] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:16.231209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc109-f823-4740-b8a7-a76ac73f3340 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.231508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc109-f823-4740-b8a7-a76ac73f3340 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.231778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc109-f823-4740-b8a7-a76ac73f3340 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.233663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 51/107] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:16.238171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fa576-4d1c-4ddf-a030-5007b8b4e4fd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.238171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fa576-4d1c-4ddf-a030-5007b8b4e4fd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.238171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fa576-4d1c-4ddf-a030-5007b8b4e4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.246394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.247095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.247370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.247649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.248433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:16.248743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:16.250221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a05823-d90f-4710-9b61-4b57e4cf3a7f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:16.258185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-274fa576-4d1c-4ddf-a030-5007b8b4e4fd None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:16.259781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-274fa576-4d1c-4ddf-a030-5007b8b4e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:16.264836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 57/108] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:16.266425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.266726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.267004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.285032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:16.286239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:16.341764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 52/109] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:16.342938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.343230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.343513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.361467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:16.362725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:16.379899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:16.381417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.458900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 53/111] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:16.461010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.505081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6af14-2ed3-4ac8-8b48-b773f9cdd08b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.541482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.542304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.542588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.542880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.544367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:16.546015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:16.547682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 59/112] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:16.548439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.571450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95a73-cc63-410b-8939-cd374af35f4c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.605624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.606480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.606763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.607038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.616948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:16.623827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:16.629924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 54/113] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:16.629924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.651663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108970c-d642-46ed-b95a-60575c212a74 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.688178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.689018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.689301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.689573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.699794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:16.706811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:16.708041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 60/114] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:16.709837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.738540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95728e-d1bc-43cb-9efa-64ccb9835c86 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.777793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29780f-846f-4720-bf89-99107d34b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.778589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29780f-846f-4720-bf89-99107d34b39f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.778871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29780f-846f-4720-bf89-99107d34b39f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.779145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29780f-846f-4720-bf89-99107d34b39f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.789296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29780f-846f-4720-bf89-99107d34b39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:16.796859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-7c29780f-846f-4720-bf89-99107d34b39f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:16.798042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 55/115] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:16.799242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db50d2-1330-4db0-b618-4253548d766e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.799531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db50d2-1330-4db0-b618-4253548d766e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.799808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db50d2-1330-4db0-b618-4253548d766e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.805173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 56/116] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:16.805173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db50d2-1330-4db0-b618-4253548d766e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.821746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b28cd-aabb-49f1-8a50-4d7ec3621384 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.857725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.858823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.859105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.859381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.860593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:16.862082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:16.863941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 61/117] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:16.868834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.911691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db50d2-1330-4db0-b618-4253548d766e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:16.945227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:16.946169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:16.946452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:16.946731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:16.947475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:16.947792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:16.949210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:16.962457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 57/118] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:16.963243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:16.970711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9331-9336-4538-bd34-d124dca5841a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.004268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.004959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.005246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.005518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.006620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:17.007039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.008441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afa758-8964-4e34-ae8d-e1f767142f14 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.022397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 62/119] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.022397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.022397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.022397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.035983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:17.037283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:17.067039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020d8a-1d6d-4277-8e76-a1d21785ee93 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.100148 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.101025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.101310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.101583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.102052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 63/120] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:17.102675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.113225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:17.113542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.115411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.126120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.127380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.205079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0664e-67b7-49af-bc88-aa9db4e5d466 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.225451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ce13c-a95e-46e4-a4c5-600ec2352b28 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.238740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.239639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.239915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.240194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/664039323cb74005a11f2571bdf1b455/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.242235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] RBAC: Authorizing `identity:create_grant(project_id=a1fb1b92ff18438caab069f229ad3f71, user_id=664039323cb74005a11f2571bdf1b455, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.243682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.259357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 64/122] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:17 2022] PUT /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/664039323cb74005a11f2571bdf1b455/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:17.260359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.269524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.270795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.271227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.271753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.273885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.275562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.278423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 59/123] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.279254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.392368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef562a-49fc-44db-82bf-1f7830ab9cac None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.416378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814b89-0948-4ec9-bdaf-ecc60606540e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.439307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.440479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.440757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.441070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.443002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.445535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.448330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 65/124] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.449447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.454016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.455051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.455437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.455815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.480812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:17.480812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:17.480812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 60/125] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:17.480812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.560449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62815a9c-ceba-40f4-8b04-6d5bb24b8988 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.592418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc89fe-6923-4260-8c7b-cf80c3217088 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.596030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.597146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.597594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.598000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] PATH_INFO: `/v3/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.613796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] RBAC: Authorizing `identity:get_user(user_id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.615605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.617731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 66/126] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.618647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.626617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.627756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.627756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.628030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.629252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.630726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.632911 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 61/127] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.638311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.725372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaac20-03bd-4ea9-ac1c-ccfd3f95900d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.741358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b704c7-c6dc-4ef2-8493-d2c67cb504f6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.760883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.762472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.763143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.763566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] PATH_INFO: `/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.765539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] RBAC: Authorizing `identity:get_project(project_id=6c776cbb7a3347a4ba95a7b0e10950cd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.767814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.770483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.771399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.780731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.781759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.781759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.782190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.783015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:17.783390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.784860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.798668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 62/129] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:17.799726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:17.893681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507d33-83c4-4ad4-ba9e-b23ca2dfdaeb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.903847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d494-d333-4d57-bb07-b5ae18b70fd7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:17.927932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.929001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.929426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.929835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.937550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:17.938459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:17.938740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:17.939015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/0d8085b78f244bdfbf8da4f7668ae4fd/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:17.941047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] RBAC: Authorizing `identity:create_grant(project_id=a1fb1b92ff18438caab069f229ad3f71, user_id=0d8085b78f244bdfbf8da4f7668ae4fd, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:17.942498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:17.960471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 63/130] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:17 2022] PUT /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/0d8085b78f244bdfbf8da4f7668ae4fd/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:17.970131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:18.004975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.007189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.115307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2167dbd-e86f-4aa7-b3d7-1e3227e60a2c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:18.155429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 68/131] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:18.157221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:18.162988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:18.163915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.164202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.164480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] PATH_INFO: `/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd/users/664039323cb74005a11f2571bdf1b455/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.167586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c776cbb7a3347a4ba95a7b0e10950cd, user_id=664039323cb74005a11f2571bdf1b455, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.173263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.202370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 64/132] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:17 2022] PUT /identity/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd/users/664039323cb74005a11f2571bdf1b455/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:18.203524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:18.337306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a86bb-7312-4f4f-88b2-af1cd38fddc5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:18.343227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911baaab-fc07-475c-bd41-944efc069cac None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:18.374833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:18.375850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.376058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.376344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.377611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.379245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.381132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 65/133] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:18 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:18.383097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:18.384031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.384319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.384593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.385892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.387406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.388536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:18.389182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 69/134] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:18 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:18.395528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:18.494890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0be3-80bc-45e4-a57b-002bb448d312 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:18.500473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775e30d-1236-45a0-ac89-be3aa3fb87ea None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:18.533517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:18.534515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.534972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.535582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.536605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] RBAC: Adding query filter params (role.id=1d2250af682e430c9e12705f59c934b8, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:18.536723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:18.537305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.537871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.538259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.538605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.539539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab4c77-1bad-46eb-b873-02929f1e518d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.539963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.541691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.543719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 70/135] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:18 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:18.546942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 66/136] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:18 2022] GET /identity/v3/role_assignments?user.id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=1d2250af682e430c9e12705f59c934b8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:18.552946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:18.659693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7a33-5907-45ac-af34-8f1ef111fe54 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:18.697794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed45d5-8389-4940-8c02-17f3a675657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:18.699034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed45d5-8389-4940-8c02-17f3a675657d None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.699473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed45d5-8389-4940-8c02-17f3a675657d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.699897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed45d5-8389-4940-8c02-17f3a675657d None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/664039323cb74005a11f2571bdf1b455/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.702456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed45d5-8389-4940-8c02-17f3a675657d None admin] RBAC: Authorizing `identity:create_grant(project_id=a1fb1b92ff18438caab069f229ad3f71, user_id=664039323cb74005a11f2571bdf1b455, role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:18.704098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed45d5-8389-4940-8c02-17f3a675657d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:18.721568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 71/137] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:18 2022] PUT /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/664039323cb74005a11f2571bdf1b455/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:18.876491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27587c9-f625-4d2d-98d8-d867d0f8097b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.877033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27587c9-f625-4d2d-98d8-d867d0f8097b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.877106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27587c9-f625-4d2d-98d8-d867d0f8097b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.879108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 67/138] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:18.884695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:18.885238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:18.885653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:18.906636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:18.908082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:18.989313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 72/139] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:19.026154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27587c9-f625-4d2d-98d8-d867d0f8097b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:19.133071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27587c9-f625-4d2d-98d8-d867d0f8097b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:19.169985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f8eb9-71bc-47b3-b558-094d46ac8760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:19.170868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f8eb9-71bc-47b3-b558-094d46ac8760 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:19.171156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f8eb9-71bc-47b3-b558-094d46ac8760 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:19.171435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f8eb9-71bc-47b3-b558-094d46ac8760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:19.172616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f8eb9-71bc-47b3-b558-094d46ac8760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:19.174149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f8eb9-71bc-47b3-b558-094d46ac8760 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:19.176092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 68/140] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:19.181515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:19.285732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3040a-0f2d-4532-a9ba-5d273ee612dd None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:19.321510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ad32b-a954-4f35-85c3-1c11c004afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:19.322202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad32b-a954-4f35-85c3-1c11c004afd0 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:19.322488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad32b-a954-4f35-85c3-1c11c004afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:19.322767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad32b-a954-4f35-85c3-1c11c004afd0 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:19.323483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad32b-a954-4f35-85c3-1c11c004afd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:19.324987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad32b-a954-4f35-85c3-1c11c004afd0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:19.348657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 73/141] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:19 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:56:20.240571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263c5cb-f861-4b9e-9572-2cbdb7a551d4 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:20.241286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263c5cb-f861-4b9e-9572-2cbdb7a551d4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:20.241286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263c5cb-f861-4b9e-9572-2cbdb7a551d4 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:20.243586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 69/142] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:20.249312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:20.249756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:20.249955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:20.267784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:20.269025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:20.337597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 74/143] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:20.362571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263c5cb-f861-4b9e-9572-2cbdb7a551d4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:20.468200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263c5cb-f861-4b9e-9572-2cbdb7a551d4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:20.502864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:20.503614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:20.503898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:20.504217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:20.515169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:20.522618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:20.524230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 70/144] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:20.530562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:20.634131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d821be7-fede-4be0-a490-5ab09f1a1543 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:20.669236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:20.669919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:20.670203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:20.670481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:20.671243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:20.671550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:20.672969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:20.682168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 75/145] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:20.687715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:20.789495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc905e-a9e5-4c74-ae8f-76680418d8c4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:20.824732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:20.825725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:20.826012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:20.826286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:20.827502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:20.829014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:20.830948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 71/146] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:20 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:20.836604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:20.938516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a091b-ca73-48c5-b6c4-da9dfa04adf0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:20.973763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:20.974430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:20.974776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:20.975057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:21.045213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:21.046630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:21.147238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 76/147] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:21.153093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:21.268101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702467e-7b2d-4f1c-98d6-c27b03e2aff9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:21.305212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9823fcb-49dc-458f-963a-9f976d11bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:21.306014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9823fcb-49dc-458f-963a-9f976d11bd8f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:21.306299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9823fcb-49dc-458f-963a-9f976d11bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:21.306576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9823fcb-49dc-458f-963a-9f976d11bd8f None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:21.307813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9823fcb-49dc-458f-963a-9f976d11bd8f None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:21.309314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9823fcb-49dc-458f-963a-9f976d11bd8f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:21.311215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 72/148] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:21 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:21.317262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:21.436996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a7a34-b635-42d3-b904-2bd956afc307 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:21.471662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:21.472333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:21.472618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:21.472908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:21.473842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=664039323cb74005a11f2571bdf1b455) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:21.474159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:21.475749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cc3f3-06cb-483d-8761-7c1a9b66444d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:21.481894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 77/149] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:21 2022] GET /identity/v3/role_assignments?user.id=664039323cb74005a11f2571bdf1b455&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:22.111185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ebaa-d25e-414f-a34a-5a2cfe25a2cc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.111386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ebaa-d25e-414f-a34a-5a2cfe25a2cc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.111836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ebaa-d25e-414f-a34a-5a2cfe25a2cc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.114110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 73/150] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:22.120171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.120765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.121269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.143165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:22.144738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:22.221714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 78/151] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:22.267237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ebaa-d25e-414f-a34a-5a2cfe25a2cc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:22.378896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ebaa-d25e-414f-a34a-5a2cfe25a2cc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:22.415678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd49fb-9c4e-4d00-b66a-7ce843b1ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:22.416924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd49fb-9c4e-4d00-b66a-7ce843b1ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.417444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd49fb-9c4e-4d00-b66a-7ce843b1ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.417947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd49fb-9c4e-4d00-b66a-7ce843b1ecf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.430358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd49fb-9c4e-4d00-b66a-7ce843b1ecf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:22.438220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-84dd49fb-9c4e-4d00-b66a-7ce843b1ecf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:22.440027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 74/152] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:22.446965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:22.552841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054709fc-e0d2-406d-ae6d-fa6273eb4234 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:22.557009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f5b55-3e4d-43ce-b8d0-468b528a6075 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.557566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f5b55-3e4d-43ce-b8d0-468b528a6075 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.558036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f5b55-3e4d-43ce-b8d0-468b528a6075 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.560288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 75/153] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:22.564945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be998165-5302-4501-9efe-a5f5be35b874 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.565458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be998165-5302-4501-9efe-a5f5be35b874 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.565943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be998165-5302-4501-9efe-a5f5be35b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.585337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-be998165-5302-4501-9efe-a5f5be35b874 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:22.587636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-be998165-5302-4501-9efe-a5f5be35b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:22.634781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:22.635401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.635688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.635968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.636733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:22.637067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:22.638521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:22.649501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 79/154] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:22.655258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:22.664564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 76/155] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:22.701561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7151-dd54-4e97-b593-964b33bed0ae None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.702196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7151-dd54-4e97-b593-964b33bed0ae None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.702662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7151-dd54-4e97-b593-964b33bed0ae None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.704765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 77/156] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:22.710212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.711129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.711786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.736742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:22.738332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:22.814202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 78/157] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:22.815417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:22.915119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319304ce-0614-476f-9849-ce2075ffd6a5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:22.927834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03e8ff-ef28-4207-8592-15d5d1996f91 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:22.969560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:22.970387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:22.970657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:22.970930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:22.990321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:22.997871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:22.999105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 79/158] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:22.999876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.002639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3703422-9ec2-4cbf-b11f-311dd0a76819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.003535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703422-9ec2-4cbf-b11f-311dd0a76819 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.003869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703422-9ec2-4cbf-b11f-311dd0a76819 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.004138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703422-9ec2-4cbf-b11f-311dd0a76819 None admin] PATH_INFO: `/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.005384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703422-9ec2-4cbf-b11f-311dd0a76819 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8085b78f244bdfbf8da4f7668ae4fd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:23.006945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703422-9ec2-4cbf-b11f-311dd0a76819 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:23.008714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 80/159] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:22 2022] GET /identity/v3/users/0d8085b78f244bdfbf8da4f7668ae4fd => generated 247 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:23.009766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63ac2-9c74-445f-ad2b-9d75c6a80406 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.010072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63ac2-9c74-445f-ad2b-9d75c6a80406 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.010319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63ac2-9c74-445f-ad2b-9d75c6a80406 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.012981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 81/160] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:23.014074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63ac2-9c74-445f-ad2b-9d75c6a80406 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.122820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14ced-5af3-4fa3-ba63-c1a1efb3d3b0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.166026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba58390-e33f-4277-81e0-b7f5e5b8df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.166765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58390-e33f-4277-81e0-b7f5e5b8df25 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.167041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58390-e33f-4277-81e0-b7f5e5b8df25 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.167311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58390-e33f-4277-81e0-b7f5e5b8df25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.190451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba58390-e33f-4277-81e0-b7f5e5b8df25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:23.205097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-aba58390-e33f-4277-81e0-b7f5e5b8df25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:23.213978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 80/161] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:23.215300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.215581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.215855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.225902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63ac2-9c74-445f-ad2b-9d75c6a80406 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.257922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:23.259144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:23.272524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.273887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.274359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.274847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.275816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:23.276321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:23.278190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:23.295054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 82/162] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:23.296223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.375937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 81/163] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:23.377155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.482732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f88d4b-57d1-4179-9d8b-34eb6b8cfec2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.518629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.519741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.520219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.520457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34354-0591-4365-a146-37f48e40de75 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.521270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.522366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:23.523241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:23.525036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:23.533861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 82/164] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:23.534935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.609772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.610436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.610714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.610982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.638364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6bb5-7ccc-4bc1-a83e-227f44b10164 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.673662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.674920 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.675397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.675879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.677377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:23.679486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:23.681426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 83/165] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:23.682392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.747071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:23.748389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:23.785436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22296f35-66fb-4de1-856c-a6575332a5ef None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.822343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.823587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.824062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.824670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.836129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:23.843706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:23.845570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 84/166] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:23.847305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.892543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 83/167] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:23.893436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:23.955947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffca980-5b4e-4ee9-8cc3-bba5788140aa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.990503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c280-3f8f-453b-882a-c32c1f8b3177 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:23.993339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09d49-f041-4e64-b0da-ac90956bc3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:23.994559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09d49-f041-4e64-b0da-ac90956bc3d6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:23.995033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09d49-f041-4e64-b0da-ac90956bc3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:23.995498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09d49-f041-4e64-b0da-ac90956bc3d6 None admin] PATH_INFO: `/v3/users/664039323cb74005a11f2571bdf1b455` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:23.996933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09d49-f041-4e64-b0da-ac90956bc3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=664039323cb74005a11f2571bdf1b455)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:23.998732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09d49-f041-4e64-b0da-ac90956bc3d6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.000595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 85/168] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/users/664039323cb74005a11f2571bdf1b455 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.002047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a153d5-55c5-4d53-a472-3c01506578dd None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.002532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a153d5-55c5-4d53-a472-3c01506578dd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.002998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a153d5-55c5-4d53-a472-3c01506578dd None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.004922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 86/169] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:24.006058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a153d5-55c5-4d53-a472-3c01506578dd None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.028981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.029639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.029915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.030187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.100557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.102000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.120963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a153d5-55c5-4d53-a472-3c01506578dd None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.156204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.157107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.157778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.158069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.159130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:24.159685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.162071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.174951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 87/170] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.175945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.217897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 84/171] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:24.218898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.283520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cc9c-f0cd-4e5a-9c17-2cb95bad9158 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.317038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f033fbd-e315-48de-ad50-a6b383ed7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.318448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033fbd-e315-48de-ad50-a6b383ed7264 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.318732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033fbd-e315-48de-ad50-a6b383ed7264 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.318995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033fbd-e315-48de-ad50-a6b383ed7264 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.320467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f033fbd-e315-48de-ad50-a6b383ed7264 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.322457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f033fbd-e315-48de-ad50-a6b383ed7264 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.324392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 88/172] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.326567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.327011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.327446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.342319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251725c-6012-4578-85c7-0a06c6a7afab None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.347775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:24.348960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:24.382467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.383133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.383393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.383662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.419122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 89/173] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:24.420397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.451621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.453129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.517895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd62f4-61ea-4d1b-823f-aca44bcd8498 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.551357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 85/174] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:24.552191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.553784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.554713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.554989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.555319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] PATH_INFO: `/v3/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.556539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.558030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.559632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 90/175] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.561483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.648242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c5b08-36f4-4fc4-9a2f-9fffe081564d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.654025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce24c1b-bdf2-41ca-8689-6a9b09532cc8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.683724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdf861-2f2d-4a63-880f-1c49cbf3e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.684571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf861-2f2d-4a63-880f-1c49cbf3e26e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.684892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf861-2f2d-4a63-880f-1c49cbf3e26e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.685197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf861-2f2d-4a63-880f-1c49cbf3e26e None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.685989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.686417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdf861-2f2d-4a63-880f-1c49cbf3e26e None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.686638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.686916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.687189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.687927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdf861-2f2d-4a63-880f-1c49cbf3e26e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.688060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=0d8085b78f244bdfbf8da4f7668ae4fd) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:24.688351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.689650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 86/176] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.689847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.694798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc922-ea1e-4a8f-9857-1cef34ac6ac9 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.695080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc922-ea1e-4a8f-9857-1cef34ac6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.695358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc922-ea1e-4a8f-9857-1cef34ac6ac9 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.696176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 91/177] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/role_assignments?user.id=0d8085b78f244bdfbf8da4f7668ae4fd&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.696947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.697063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 87/178] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:24.702302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edda9-1a34-4db7-b142-61030481a196 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.702533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edda9-1a34-4db7-b142-61030481a196 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.702838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edda9-1a34-4db7-b142-61030481a196 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.704849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 88/179] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:24.705588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100edda9-1a34-4db7-b142-61030481a196 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.804025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c6c8-3d0d-411c-9469-79d10a721036 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.816209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100edda9-1a34-4db7-b142-61030481a196 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.849832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.850765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.851144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.851415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.852210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.853114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.853398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.853664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] PATH_INFO: `/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.854888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] RBAC: Authorizing `identity:get_project(project_id=6c776cbb7a3347a4ba95a7b0e10950cd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:24.856362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:24.858180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 89/180] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/projects/6c776cbb7a3347a4ba95a7b0e10950cd => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:24.858978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.867743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:24.877941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:24.879873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 92/181] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:24.881072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:24.963942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75245731-71a5-48e4-9907-1f37ccd20913 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.986032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3875-328d-4cb5-a2b4-7f01537e9c42 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:24.997066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484c2f-314f-4939-8ef7-c4c66e0ff827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:24.997944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484c2f-314f-4939-8ef7-c4c66e0ff827 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:24.998221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484c2f-314f-4939-8ef7-c4c66e0ff827 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:24.998492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484c2f-314f-4939-8ef7-c4c66e0ff827 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:24.999677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484c2f-314f-4939-8ef7-c4c66e0ff827 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.001168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484c2f-314f-4939-8ef7-c4c66e0ff827 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.002884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 90/182] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.004009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.004290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.004566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.020090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.020750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.021082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:25.021206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.021428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.022265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] RBAC: Adding query filter params (role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=664039323cb74005a11f2571bdf1b455) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:25.022362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:25.022578 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.024377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f3468-7506-4e28-96e2-71bb93e5a8fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.032408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 93/183] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:24 2022] GET /identity/v3/role_assignments?user.id=664039323cb74005a11f2571bdf1b455&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.034374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.034832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.035289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.054590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:25.055757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:25.104926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 91/184] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:25.104926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.144559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 94/185] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:25.145792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.216236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273988c-a1e3-4850-be2c-cd4bfccf2000 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.256414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.257376 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.257657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.257927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.258939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=6c776cbb7a3347a4ba95a7b0e10950cd, user.id=664039323cb74005a11f2571bdf1b455) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:25.259251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.261340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.265601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6b57-b3ad-41b2-93de-532cc7be777e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.267802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 92/186] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/role_assignments?user.id=664039323cb74005a11f2571bdf1b455&scope.project.id=6c776cbb7a3347a4ba95a7b0e10950cd&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.268592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.308487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.310539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.311050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.311461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.312417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:25.312862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.314499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.324631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 95/187] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.325875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.389726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c2d5-248e-4251-8d39-edd9c2a7d28b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.425995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.426948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.427229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.427528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac/roles/1d2250af682e430c9e12705f59c934b8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.429709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] RBAC: Authorizing `identity:create_grant(project_id=a1fb1b92ff18438caab069f229ad3f71, user_id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac, role_id=1d2250af682e430c9e12705f59c934b8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.431189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.436279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa83f0-dc79-44cf-9096-a1ffa93be088 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.457237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 93/188] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:25 2022] PUT /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac/roles/1d2250af682e430c9e12705f59c934b8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:25.457237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.496586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.497458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.497749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.498011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.499937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.501475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.503320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 96/189] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.503932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.573388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4be6-ff5e-4b68-b6fc-0bb604b8df2a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.613116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.613971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.614254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.614523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.625725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:25.633714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:25.635164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40483-0447-48f4-a3a3-55a5a9227eea None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.635627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 94/190] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:25.635822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.680025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.680924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.681202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.681470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] PATH_INFO: `/v3/users/22dc6dc70c5c4a878864d302606a47e6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.694600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] RBAC: Authorizing `identity:get_user(user_id=22dc6dc70c5c4a878864d302606a47e6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.696063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.697948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 97/191] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/users/22dc6dc70c5c4a878864d302606a47e6 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.698535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.747657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6688-1bae-4226-95d2-01a58b657112 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.782129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.782805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.783087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.783360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.784075 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.785579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.799142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa02c9-03a8-4227-8d0e-0af1bc33727a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.812560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 95/192] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:25 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:25.813429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.852184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:25.853174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:25.853811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:25.854231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:25.855830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:25.856404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:25.858367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:25.870404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 98/193] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:25.876251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:25.954074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de6eb-5c76-41e0-a01b-9faaeaee62a2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:25.987967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f362d-cb7e-4d2b-9502-09dc2454bbdd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:26.001323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.002451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.002879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.003669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.029407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.030392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.030737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.031076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] PATH_INFO: `/v3/users/22dc6dc70c5c4a878864d302606a47e6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.032349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] RBAC: Authorizing `identity:get_user(user_id=22dc6dc70c5c4a878864d302606a47e6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.033933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.035675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 99/194] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/users/22dc6dc70c5c4a878864d302606a47e6 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:26.041556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:26.098643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.100381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.169653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507c74-13b9-4db6-b9d5-feec73d6e30e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:26.207856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.209152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.209696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.210238 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.220026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 96/195] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:26.228948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:26.290629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.292132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.343796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615e378-37db-4978-aea1-d497f4c08474 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:26.387793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.388844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.389288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.389565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.391216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.392819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.394845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 97/197] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:26 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:26.397025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 100/197] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:26.401000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:26.401919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:26.554405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50eda8-5208-4217-be05-b7126f78e764 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:26.567664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d38e5-4888-4dbc-bc7d-45d59a484be7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:26.621270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.622149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.622433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.622701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.623897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.624356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.625294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.625506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.625956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.626435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.632097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 98/198] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:26 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:26.632951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=22dc6dc70c5c4a878864d302606a47e6) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:26.633500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:26.633703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.635555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfed12-9036-4226-9f5c-fc492b53d8da None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.651333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 101/199] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:26 2022] GET /identity/v3/role_assignments?user.id=22dc6dc70c5c4a878864d302606a47e6&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:26.780529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9d58-75d5-41f8-b2ec-1b52c2ef2e1c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:26.837754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:26.838441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:26.838715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:26.838985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:26.839831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] RBAC: Adding query filter params (role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=22dc6dc70c5c4a878864d302606a47e6) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:26.840136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:26.841632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8d8e1-a603-4d1d-9522-c515fc2ce8c0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:26.847994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 99/200] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:26 2022] GET /identity/v3/role_assignments?user.id=22dc6dc70c5c4a878864d302606a47e6&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:28.032935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a406-8d17-4b27-a099-ad87027f4e17 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.032935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a406-8d17-4b27-a099-ad87027f4e17 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.032935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a406-8d17-4b27-a099-ad87027f4e17 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.034158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 102/201] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:28.040352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.041309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.041777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.059585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:28.061144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:28.136736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 100/202] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:28.185288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a406-8d17-4b27-a099-ad87027f4e17 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:28.318983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a406-8d17-4b27-a099-ad87027f4e17 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:28.360209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:28.361039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.361318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.361587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.377758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:28.385001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:28.387359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 103/203] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:28.398400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:28.515277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b7df1-309b-4350-bedb-88323afdb6e5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:28.556761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:28.557489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.557765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.558037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.558816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:28.559117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:28.560642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6237bfb-84bf-4f67-862e-49ffce22ab0a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:28.570887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 101/204] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:28.576487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:28.673481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8553-d18d-4e92-b1d4-e04c12944132 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.673771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8553-d18d-4e92-b1d4-e04c12944132 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.673948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d8553-d18d-4e92-b1d4-e04c12944132 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.675780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 102/205] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:28.680724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.681038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.681309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.702009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:28.703189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:28.754560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24655cc9-ee34-487d-ac35-e7f215010cd6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:28.822594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:28.823478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:28.823750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:28.824017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] PATH_INFO: `/v3/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:28.825368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] RBAC: Authorizing `identity:get_user(user_id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:28.832934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:28.832934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 104/206] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:28 2022] GET /identity/v3/users/8cc5d6c56c5d4dca8fadc65d9dcfc4ac => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:28.834114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:28.834572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 103/207] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:28.866213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:28.977043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664bb05-a6f4-47d5-8755-4049a51e8850 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.012596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.013886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.014362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.014827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.027569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:29.035252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:29.036973 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 104/208] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:29.042658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.112881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7061-865f-4a71-a34e-4c066454616c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.144934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded92370-fd24-41e3-a019-d35718969579 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.167445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e842-28e2-4530-997b-698751a48079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.168374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e842-28e2-4530-997b-698751a48079 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.168791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e842-28e2-4530-997b-698751a48079 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.169232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e842-28e2-4530-997b-698751a48079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.182662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.183344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.183630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.183907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.184671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:29.185004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.186414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261575bc-6a92-4bdc-8b3a-e7b853777eb5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.195398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 105/209] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:29.196865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006dbe-350c-4e71-ab12-f30e12592518 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.197309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006dbe-350c-4e71-ab12-f30e12592518 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.197719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006dbe-350c-4e71-ab12-f30e12592518 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.199757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 106/210] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:29.200667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c006dbe-350c-4e71-ab12-f30e12592518 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.243024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e842-28e2-4530-997b-698751a48079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.244727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e842-28e2-4530-997b-698751a48079 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.304538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c006dbe-350c-4e71-ab12-f30e12592518 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.338867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.340557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.341009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.341433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] PATH_INFO: `/v3/users/578e3c8f8e11483da4b5718caad257c3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.342967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 105/211] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:29.344623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.345169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.345684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.357534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] RBAC: Authorizing `identity:get_user(user_id=578e3c8f8e11483da4b5718caad257c3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.359033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.360979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 107/212] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/users/578e3c8f8e11483da4b5718caad257c3 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:29.366092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.370170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:29.371536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:29.440743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 106/213] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:29.442071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.476867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a9e0-9f31-4b96-aa6c-14d8ad3aa613 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.512730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee50c-efc5-40ff-92c2-38fa33eed3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.513550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee50c-efc5-40ff-92c2-38fa33eed3ac None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.513824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee50c-efc5-40ff-92c2-38fa33eed3ac None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.514087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee50c-efc5-40ff-92c2-38fa33eed3ac None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.515295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee50c-efc5-40ff-92c2-38fa33eed3ac None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.516743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee50c-efc5-40ff-92c2-38fa33eed3ac None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.518667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 108/214] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:29.522442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0256d-7ce9-4a0f-a5ed-1447efdcaed7 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.523340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0256d-7ce9-4a0f-a5ed-1447efdcaed7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.523824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0256d-7ce9-4a0f-a5ed-1447efdcaed7 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.525898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 109/215] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:29.526811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0256d-7ce9-4a0f-a5ed-1447efdcaed7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.551371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36b586-aaa8-413a-86c5-c488940fe715 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.585347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835822f2-cea3-4358-818e-84b3e04a5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.586007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835822f2-cea3-4358-818e-84b3e04a5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.586284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835822f2-cea3-4358-818e-84b3e04a5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.586554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835822f2-cea3-4358-818e-84b3e04a5fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.631433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0256d-7ce9-4a0f-a5ed-1447efdcaed7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.654356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835822f2-cea3-4358-818e-84b3e04a5fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.655829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835822f2-cea3-4358-818e-84b3e04a5fb7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.666525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.667347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.667624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.667862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.669097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.670504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.672110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 110/216] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:29.677024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.757117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 107/217] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:29.757117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.757117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.757117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.775972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:29.777112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:29.785269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ca68-2ca2-44cf-8c8d-f38faba65675 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.827369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.828035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.828347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.828588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.829464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] RBAC: Adding query filter params (role.id=1d2250af682e430c9e12705f59c934b8, scope.project.id=a1fb1b92ff18438caab069f229ad3f71, user.id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:29.829770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.831212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:29.845195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 111/218] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/role_assignments?user.id=8cc5d6c56c5d4dca8fadc65d9dcfc4ac&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=1d2250af682e430c9e12705f59c934b8 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:29.845195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.858912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 108/219] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:29.858912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:29.945009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95021-a671-452a-b3f6-65329734d48f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.976006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd983f1-0057-41e2-9e5f-00c36f616ded None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:29.981608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb6460-95c1-46db-9206-d1520985aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:29.982308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6460-95c1-46db-9206-d1520985aaf7 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:29.982592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6460-95c1-46db-9206-d1520985aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:29.982867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6460-95c1-46db-9206-d1520985aaf7 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:29.983596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb6460-95c1-46db-9206-d1520985aaf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:29.985104 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb6460-95c1-46db-9206-d1520985aaf7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.007335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 112/220] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:29 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:30.008752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d77b1-aef2-47ec-8629-e4e7e4e70648 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.009068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d77b1-aef2-47ec-8629-e4e7e4e70648 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.009351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d77b1-aef2-47ec-8629-e4e7e4e70648 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.015774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 113/221] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:30.015774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d77b1-aef2-47ec-8629-e4e7e4e70648 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.026919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf2c19-7ebe-4d98-88ed-a2bf1ade70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.029159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf2c19-7ebe-4d98-88ed-a2bf1ade70a4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.029746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf2c19-7ebe-4d98-88ed-a2bf1ade70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.030744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf2c19-7ebe-4d98-88ed-a2bf1ade70a4 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.033170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf2c19-7ebe-4d98-88ed-a2bf1ade70a4 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.035730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf2c19-7ebe-4d98-88ed-a2bf1ade70a4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.039711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 109/222] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:29 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:30.042182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.042468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.042742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.065860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:30.067164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:30.137154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d77b1-aef2-47ec-8629-e4e7e4e70648 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.145761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 110/223] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:30.150629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.177296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.178714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.178993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.179263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.191293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:30.198851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:30.200175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 114/224] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:30.200933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.254169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd6e6-ebcc-4004-a983-e79ca0e5eed0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.290818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.291416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.292132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.292132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.293186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=578e3c8f8e11483da4b5718caad257c3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:30.293186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.294599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.305099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 111/225] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/role_assignments?user.id=578e3c8f8e11483da4b5718caad257c3&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:30.306404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.317492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3282589-7528-45ee-b3bf-0acc9e2f9e99 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.370318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.371843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.372277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.373007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.394263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:30.403137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:30.404426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 115/226] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:30.410650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.435604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11fa36-eaa2-45c4-80bc-464640476c73 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.472754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.473462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.473740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.474003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.475088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:30.475390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.476805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.486048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 112/227] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:30.491898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.534317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f285e-80c4-485a-8a3d-e4d98561f22e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.570931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.572101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.572590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.573104 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.574536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:30.574913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.576758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.586254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 116/228] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:30.591818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.595327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c686444-5d17-4535-a6cf-b22d19664378 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.639213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.640105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.640430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.640937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] PATH_INFO: `/v3/users/22dc6dc70c5c4a878864d302606a47e6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.643068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] RBAC: Authorizing `identity:get_user(user_id=22dc6dc70c5c4a878864d302606a47e6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.645387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.648173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 113/229] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/users/22dc6dc70c5c4a878864d302606a47e6 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:30.657891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.706965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4373b8-f837-4199-b636-fb72b7ddc913 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.745080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.746020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.746376 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.746654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] PATH_INFO: `/v3/users/22dc6dc70c5c4a878864d302606a47e6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.748321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] RBAC: Authorizing `identity:get_user(user_id=22dc6dc70c5c4a878864d302606a47e6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.750121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.751819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 117/230] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/users/22dc6dc70c5c4a878864d302606a47e6 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:30.761838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.873985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8554d4b-70f6-4509-be8d-4a9e164d4929 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.895963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eaf24-28c4-48a3-a16d-9c7dafa48066 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:30.940032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.940944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.941229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.944377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.947086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.949169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.951635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 118/231] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:30.965626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:30.966954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:30.967242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:30.967521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:30.969935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:30.970890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:30.972454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:30.982558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 114/232] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:30 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:30.985196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:31.186733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cb8bf-4a1c-47ea-a118-ffeb9bdefb72 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:31.194105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525cd55-f4e2-470c-87d0-0f9a87740a3d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:31.263063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6793c7-3034-42e6-8ceb-7751656aedaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:31.267457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6793c7-3034-42e6-8ceb-7751656aedaa None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:31.267457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6793c7-3034-42e6-8ceb-7751656aedaa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:31.267457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6793c7-3034-42e6-8ceb-7751656aedaa None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974/users/22dc6dc70c5c4a878864d302606a47e6/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:31.270100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6793c7-3034-42e6-8ceb-7751656aedaa None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf4263f55664a669e4c25514205b974, user_id=22dc6dc70c5c4a878864d302606a47e6, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:31.271665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6793c7-3034-42e6-8ceb-7751656aedaa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:31.286343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a50b6-6178-4708-8094-bb1c4e77ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:31.287595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a50b6-6178-4708-8094-bb1c4e77ce40 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:31.287858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a50b6-6178-4708-8094-bb1c4e77ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:31.288802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a50b6-6178-4708-8094-bb1c4e77ce40 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974/users/22dc6dc70c5c4a878864d302606a47e6/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:31.293157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a50b6-6178-4708-8094-bb1c4e77ce40 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf4263f55664a669e4c25514205b974, user_id=22dc6dc70c5c4a878864d302606a47e6, role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:31.294676 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a50b6-6178-4708-8094-bb1c4e77ce40 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:31.305301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 115/233] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:30 2022] PUT /identity/v3/projects/ccf4263f55664a669e4c25514205b974/users/22dc6dc70c5c4a878864d302606a47e6/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:31.319981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 119/234] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:30 2022] PUT /identity/v3/projects/ccf4263f55664a669e4c25514205b974/users/22dc6dc70c5c4a878864d302606a47e6/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 05:56:33.165010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8fdb2-109e-4cc4-971e-bc2f4de76e31 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.165010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8fdb2-109e-4cc4-971e-bc2f4de76e31 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.165010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8fdb2-109e-4cc4-971e-bc2f4de76e31 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.165010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 116/235] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:33.171089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb2871-4f37-4deb-b038-fd74199bc74e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.171874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb2871-4f37-4deb-b038-fd74199bc74e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.172355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb2871-4f37-4deb-b038-fd74199bc74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.189734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a4eb2871-4f37-4deb-b038-fd74199bc74e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:33.191197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a4eb2871-4f37-4deb-b038-fd74199bc74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:33.257046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 120/236] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:33.280948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8fdb2-109e-4cc4-971e-bc2f4de76e31 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.319816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350af108-beee-44e4-b677-ab1c4f550efe None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.320420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350af108-beee-44e4-b677-ab1c4f550efe None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.320876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350af108-beee-44e4-b677-ab1c4f550efe None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.322882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 121/237] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:33.328313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6efed-144f-4a3e-9375-0be4e53b7fcc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.328812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6efed-144f-4a3e-9375-0be4e53b7fcc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.329306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6efed-144f-4a3e-9375-0be4e53b7fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.347722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-dbd6efed-144f-4a3e-9375-0be4e53b7fcc None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:33.349293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dbd6efed-144f-4a3e-9375-0be4e53b7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:33.403016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8fdb2-109e-4cc4-971e-bc2f4de76e31 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:33.415176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 122/238] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:33.417495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dec48-ba0e-4047-883d-53b54ada04f3 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.418242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dec48-ba0e-4047-883d-53b54ada04f3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.418908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dec48-ba0e-4047-883d-53b54ada04f3 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.421188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 123/239] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:33.429018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.429623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.430299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.441969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:33.442817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.443104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.443374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.453210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:33.454196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:33.455167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:33.461450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:33.462703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 117/240] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:33.467783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.524804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 124/241] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:33.526011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.600495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72852c23-2d24-406d-8c5f-91b5af5aa746 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:33.632791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2807a-8f22-4a71-935a-ede9c8a0b951 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:33.634805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:33.636158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.636158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.636158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.637329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:33.638788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:33.640393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 118/242] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:33.641174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.668882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:33.669814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.670232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.670637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.671548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:33.671989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:33.673534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:33.682085 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 125/243] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:33.683046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.744025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17318d-a84a-4858-acff-17f62b55c9ea None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:33.778261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:33.779364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.779652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.779963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.784312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a5cfe-6b44-4547-86c4-123c9d9428ce None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:33.793791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:33.805517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:33.807537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 119/244] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:33.813169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.830929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:33.831851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:33.832275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:33.832687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:33.833792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:33.835788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:33.861983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 126/245] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:33 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:33.863216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:33.993048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a688272-4c34-4776-b8e1-2bab84c034f5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.056002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e6a-4038-4a2a-848f-f18ffdb77d8c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.076006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.077247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.077701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.078143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] PATH_INFO: `/v3/users/e7e1c6c75a2b47f69520e87298e5fda6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.106113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e1c6c75a2b47f69520e87298e5fda6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.108550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.110662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 120/246] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:33 2022] GET /identity/v3/users/e7e1c6c75a2b47f69520e87298e5fda6 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:34.119768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.120814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.121760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.122243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.122710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.123660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:34.124173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.125965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.140333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 127/247] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:34.145940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.229908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc253fd-dd84-4622-a71a-ca33ce779a96 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.250196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e70bb-e65f-434b-9d9a-8d80c95fd353 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.265160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba2620-93e6-4633-a8d4-cafd9f650523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.265819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2620-93e6-4633-a8d4-cafd9f650523 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.266099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2620-93e6-4633-a8d4-cafd9f650523 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.266369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba2620-93e6-4633-a8d4-cafd9f650523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.283569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.284495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.284776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.285074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] PATH_INFO: `/v3/users/578e3c8f8e11483da4b5718caad257c3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.286373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] RBAC: Authorizing `identity:get_user(user_id=578e3c8f8e11483da4b5718caad257c3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.288088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.290028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 128/248] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/users/578e3c8f8e11483da4b5718caad257c3 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:34.295285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.340139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2620-93e6-4633-a8d4-cafd9f650523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.341925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba2620-93e6-4633-a8d4-cafd9f650523 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.397931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806959-b9a1-4c14-9796-1d2c32b15411 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.435135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2434-1d5d-4c71-85bd-acc268eee309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.436051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2434-1d5d-4c71-85bd-acc268eee309 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.436331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2434-1d5d-4c71-85bd-acc268eee309 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.436605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2434-1d5d-4c71-85bd-acc268eee309 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.437847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f2434-1d5d-4c71-85bd-acc268eee309 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.439813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f2434-1d5d-4c71-85bd-acc268eee309 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.442535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 129/249] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:34.443888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da0a40-81cf-48f9-b665-09f7c41a046a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.444172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da0a40-81cf-48f9-b665-09f7c41a046a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.444454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da0a40-81cf-48f9-b665-09f7c41a046a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.446155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 130/250] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:34.447214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da22c4-a2e8-4562-9186-ab932f75d99d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.447499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da22c4-a2e8-4562-9186-ab932f75d99d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.447769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da22c4-a2e8-4562-9186-ab932f75d99d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.449382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 131/251] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:34.450066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da22c4-a2e8-4562-9186-ab932f75d99d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.471124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 121/252] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:34.472811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cbad-27b8-47c1-a561-678192f3123f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.473335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cbad-27b8-47c1-a561-678192f3123f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.473813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cbad-27b8-47c1-a561-678192f3123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.491044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fe65cbad-27b8-47c1-a561-678192f3123f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:34.492267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fe65cbad-27b8-47c1-a561-678192f3123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:34.551730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da22c4-a2e8-4562-9186-ab932f75d99d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.576144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 122/253] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:34.577812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.578324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.578780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.587178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.588069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.588350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.588634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974/users/578e3c8f8e11483da4b5718caad257c3/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.590624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf4263f55664a669e4c25514205b974, user_id=578e3c8f8e11483da4b5718caad257c3, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.592253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.597981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:34.599488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:34.607686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 132/254] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:34 2022] PUT /identity/v3/projects/ccf4263f55664a669e4c25514205b974/users/578e3c8f8e11483da4b5718caad257c3/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:34.609069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.715158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 123/255] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:34.716190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.720031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc08d5-6374-4939-8a26-eedd974e8394 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.756247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.757578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.758089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.758559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.760226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:34.762048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:34.764092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 133/256] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:34.776339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.855555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1438-6d4e-41f0-811b-cc613227b1a8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.882681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa496cb5-6ab9-4f3f-a51c-29c7636ab68a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:34.890454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.891741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.891741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.891902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.903634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:34.911340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:34.912641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 124/257] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:34.913478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:34.922883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:34.924004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:34.924690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:34.925288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:34.938562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:34.946043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:34.947783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 134/258] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:34.948732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.023613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10dd0-6c00-48d8-a4b7-e333a80a86f1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.065005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353a904-818f-4d49-ba15-82f5c6a4d77b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.065464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.066134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.066413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.066687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.067693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] RBAC: Adding query filter params (role.id=1d2250af682e430c9e12705f59c934b8, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=e7e1c6c75a2b47f69520e87298e5fda6) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:35.068017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.070479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.076846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 125/259] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/role_assignments?user.id=e7e1c6c75a2b47f69520e87298e5fda6&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=1d2250af682e430c9e12705f59c934b8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:35.080397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.145953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.146543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.146825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.147102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.148262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:35.148561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.150007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.175084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 135/260] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:35.180634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.263413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c143c2-6a5c-43c9-91be-5eda180e0248 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.314613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.315305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.315584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.315856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.316623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:35.316972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.325419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.344933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 126/261] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:35.345245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.356386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdca3a-8674-4583-8676-f498cae5efa3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.403843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.405127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.405597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.406051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] PATH_INFO: `/v3/users/22dc6dc70c5c4a878864d302606a47e6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.407518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=22dc6dc70c5c4a878864d302606a47e6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.409215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.411504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 136/262] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/users/22dc6dc70c5c4a878864d302606a47e6 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:35.417897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.541437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54dde4-a367-4352-8aaf-53511d9b0ec1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.574734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.575750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.576215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.576668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.580857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d597-94a2-4d35-befb-0b8c4bef94e9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.644981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.647323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.655222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.656048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.656327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.656600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] PATH_INFO: `/v3/users/22dc6dc70c5c4a878864d302606a47e6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.661914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=22dc6dc70c5c4a878864d302606a47e6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.663528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.665295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 127/263] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/users/22dc6dc70c5c4a878864d302606a47e6 => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:35.670756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.749890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 137/264] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:35.756604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.862909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672253-389d-4f7a-aaa3-c598c7d65222 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:35.899409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:35.900658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:35.901165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:35.901945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:35.903471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:35.905330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:35.907719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 138/265] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:35.913198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:35.914305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259add-132f-4348-ab73-303dba57b0a1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:36.013617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:36.014289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:36.014570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:36.014871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:36.017065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee752c1-62d1-4d88-a18a-86f89830cade None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:36.053549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:36.054551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:36.055087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:36.055545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:36.056552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] RBAC: Adding query filter params (role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=22dc6dc70c5c4a878864d302606a47e6) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:36.057187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:36.058991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:36.066147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 139/266] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/role_assignments?user.id=22dc6dc70c5c4a878864d302606a47e6&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:36.160457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:36.162412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:36.277253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 128/267] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:36.283044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:36.426569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39109-cc7f-4428-8cb5-36cd5e7ab2f0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:36.472774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6432-ed45-452f-88d1-d43dd6477f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:36.473679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6432-ed45-452f-88d1-d43dd6477f1e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:36.474152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6432-ed45-452f-88d1-d43dd6477f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:36.474561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6432-ed45-452f-88d1-d43dd6477f1e None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:36.477715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6432-ed45-452f-88d1-d43dd6477f1e None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:36.479178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6432-ed45-452f-88d1-d43dd6477f1e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:36.481289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 140/268] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:36 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:36.488730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:36.610992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57360f-737f-4700-b6d5-5420f9a28d33 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:36.648673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:36.649708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:36.650376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:36.650898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:36.651925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=22dc6dc70c5c4a878864d302606a47e6) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:36.652422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:36.654093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34f0c1-8320-4ab0-8b34-4628907340a2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:36.660533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 129/269] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:36 2022] GET /identity/v3/role_assignments?user.id=22dc6dc70c5c4a878864d302606a47e6&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:37.266543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09087-06ac-4348-b914-33e59892f5fc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.266740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09087-06ac-4348-b914-33e59892f5fc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.267179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f09087-06ac-4348-b914-33e59892f5fc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.269156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 141/270] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:37.276514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e022dc-ce74-496a-967f-a5ae50146744 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.277029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e022dc-ce74-496a-967f-a5ae50146744 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.277443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e022dc-ce74-496a-967f-a5ae50146744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.297154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b2e022dc-ce74-496a-967f-a5ae50146744 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:37.298555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b2e022dc-ce74-496a-967f-a5ae50146744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:37.384134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 130/271] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:37.410810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09087-06ac-4348-b914-33e59892f5fc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:37.502480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a01e18-75cc-48a5-bdd1-be981792affc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.502764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a01e18-75cc-48a5-bdd1-be981792affc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.503275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a01e18-75cc-48a5-bdd1-be981792affc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.505838 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 131/272] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:37.511762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.512279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.512912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.530896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:37.532401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:37.534499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f09087-06ac-4348-b914-33e59892f5fc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:37.576310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:37.577502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.577789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.578060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.579534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:37.581289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:37.588219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 142/273] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:37.590154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:37.609141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 132/274] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:37.631665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:37.696959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538eca-669f-47bb-9d56-1a0f7bd2ce6d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:37.730979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195941-7099-4078-8d09-0746dbe776f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:37.731647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195941-7099-4078-8d09-0746dbe776f1 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.731923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195941-7099-4078-8d09-0746dbe776f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.732189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195941-7099-4078-8d09-0746dbe776f1 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.732924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195941-7099-4078-8d09-0746dbe776f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:37.734401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195941-7099-4078-8d09-0746dbe776f1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:37.754559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0337-5eef-4d6d-a296-bc47bdc52610 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:37.757313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 143/275] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:56:37 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:56:37.758513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba82bc-cba1-4cdc-8ba8-8c815ee99954 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.758797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba82bc-cba1-4cdc-8ba8-8c815ee99954 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.759365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba82bc-cba1-4cdc-8ba8-8c815ee99954 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.761005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 144/276] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:37.766659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.766979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.767202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.789239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:37.791033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:37.815277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:37.816473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:37.817022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:37.817496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:37.830517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:37.846603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:37.848523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 133/277] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:37.858795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:37.978893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca4ec-5cb6-40f8-9c2e-be9523f3daf9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.017661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.018511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 145/278] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:38.018634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.018708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.019871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.019871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:38.020043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:38.021500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:38.030695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 134/279] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:38.036114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.047164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.158520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce637-8c8f-42b4-99bc-cf02e3b3b102 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.170976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12516a72-99ae-488f-8c25-e779ca2b26f2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.198303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712fab4-1604-41db-92ea-d3058d135ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.199966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712fab4-1604-41db-92ea-d3058d135ae5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.200547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712fab4-1604-41db-92ea-d3058d135ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.201050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712fab4-1604-41db-92ea-d3058d135ae5 None admin] PATH_INFO: `/v3/users/5aedc0ec1372442aa731824edeea01cc` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.221257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712fab4-1604-41db-92ea-d3058d135ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=5aedc0ec1372442aa731824edeea01cc)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:38.222727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712fab4-1604-41db-92ea-d3058d135ae5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:38.224564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 146/280] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/users/5aedc0ec1372442aa731824edeea01cc => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:38.224987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dfc9d-8f9b-4021-b995-5fb7edb6bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.225836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7e75-0bcc-49ea-9be3-d9a188455745 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.226104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfc9d-8f9b-4021-b995-5fb7edb6bc76 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.226211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7e75-0bcc-49ea-9be3-d9a188455745 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.226373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db7e75-0bcc-49ea-9be3-d9a188455745 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.226749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfc9d-8f9b-4021-b995-5fb7edb6bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.227146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfc9d-8f9b-4021-b995-5fb7edb6bc76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.228224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 147/281] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:38.231686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7e75-0bcc-49ea-9be3-d9a188455745 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.242381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dfc9d-8f9b-4021-b995-5fb7edb6bc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:38.249448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-269dfc9d-8f9b-4021-b995-5fb7edb6bc76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:38.255548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 135/282] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:38.256976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.257266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.257543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.277551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:38.278755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:38.352870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db7e75-0bcc-49ea-9be3-d9a188455745 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.356733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 136/283] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:38.357693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.392008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.393011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.393543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.393821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.394656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, user.id=5aedc0ec1372442aa731824edeea01cc, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:38.394966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:38.397889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:38.403842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 148/284] 10.222.0.30 () {56 vars in 1308 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/role_assignments?user.id=5aedc0ec1372442aa731824edeea01cc&scope.system=all&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:38.404693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.512482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb96dd-36aa-48dd-a726-3cd653d20b5a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.557717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.558419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.558700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.559155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.559928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:38.560233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:38.561670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:38.580381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 137/285] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:38.586456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.589880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450a88-2dd8-494f-b5bd-d279b823d418 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.632150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.633361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.635018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.635644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.662309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:38.669575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:38.670985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 149/286] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:38.676713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.727997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2cefe-9d78-45b8-ae5e-39b6ac1e2440 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.764750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.772846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.772846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.772846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] PATH_INFO: `/v3/users/578e3c8f8e11483da4b5718caad257c3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.774016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] RBAC: Authorizing `identity:get_user(user_id=578e3c8f8e11483da4b5718caad257c3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:38.777027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:38.783626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 138/287] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/users/578e3c8f8e11483da4b5718caad257c3 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:38.790135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.805041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fdc9-1a50-4bfa-9dac-8eabb3617351 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:38.837895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:38.838566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:38.838842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:38.839109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:38.839850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:38.840150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:38.841560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:38.850617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 150/288] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:38.856424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:38.968751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9c25-7e60-4bf4-8caf-ba91c354d87a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:39.008102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:39.009046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:39.009323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:39.009587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] PATH_INFO: `/v3/users/e7e1c6c75a2b47f69520e87298e5fda6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:39.013330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e1c6c75a2b47f69520e87298e5fda6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:39.014767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:39.016588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 151/289] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/users/e7e1c6c75a2b47f69520e87298e5fda6 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:39.022863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:39.036561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54806-c030-4ceb-9528-836c8a9f0b73 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:39.122192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:39.122865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:39.123150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:39.123428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:39.151850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f79a-d72b-4f1a-b406-78ea04db5ef4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:39.192759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:39.194713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:39.194999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:39.196250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:39.198199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:39.199658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:39.204528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 152/290] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:39 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:39.210825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:39.277824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:39.279340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:39.388520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629d178-d5b4-4a02-a31c-9fb7ec4551d8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:39.411648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 139/291] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:39.417420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:39.425097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:39.426297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:39.426768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:39.427510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974/users/e7e1c6c75a2b47f69520e87298e5fda6/roles/1d2250af682e430c9e12705f59c934b8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:39.429879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf4263f55664a669e4c25514205b974, user_id=e7e1c6c75a2b47f69520e87298e5fda6, role_id=1d2250af682e430c9e12705f59c934b8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:39.431512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:39.474462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 153/292] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:56:39 2022] PUT /identity/v3/projects/ccf4263f55664a669e4c25514205b974/users/e7e1c6c75a2b47f69520e87298e5fda6/roles/1d2250af682e430c9e12705f59c934b8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 05:56:39.518111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca5a9-9a7a-45d6-8c35-1d6ad90b70ac None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:39.554766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aac8c-d71d-49c9-8bde-ad0b93f0f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:39.555546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aac8c-d71d-49c9-8bde-ad0b93f0f087 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:39.555827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aac8c-d71d-49c9-8bde-ad0b93f0f087 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:39.556109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aac8c-d71d-49c9-8bde-ad0b93f0f087 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:39.557338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aac8c-d71d-49c9-8bde-ad0b93f0f087 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:39.558825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9aac8c-d71d-49c9-8bde-ad0b93f0f087 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:39.560949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 140/293] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:39 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:39.566913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:39.697543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dac8-9457-4f17-a58f-7955f6688c76 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:39.751931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:39.752604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:39.752922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:39.753188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:39.754108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=578e3c8f8e11483da4b5718caad257c3) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:39.754416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:39.755966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c9edb-6a83-459e-86d8-c59f501faff5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:39.766059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 154/294] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:39 2022] GET /identity/v3/role_assignments?user.id=578e3c8f8e11483da4b5718caad257c3&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:40.506344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c97c9-daa1-4ceb-b1a6-546abe701dfa None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.507387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c97c9-daa1-4ceb-b1a6-546abe701dfa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.507889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c97c9-daa1-4ceb-b1a6-546abe701dfa None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.509957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 141/295] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:40.515639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17b24-5892-478b-b6d9-937b9a7f4ad2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.515924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17b24-5892-478b-b6d9-937b9a7f4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.516196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17b24-5892-478b-b6d9-937b9a7f4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.534464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d0b17b24-5892-478b-b6d9-937b9a7f4ad2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:40.535629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d0b17b24-5892-478b-b6d9-937b9a7f4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:40.605704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 155/296] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:40.628564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c97c9-daa1-4ceb-b1a6-546abe701dfa None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:40.684735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca891e-779d-4271-bdbd-c887ef99011f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.685093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca891e-779d-4271-bdbd-c887ef99011f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.685297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca891e-779d-4271-bdbd-c887ef99011f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.687312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 156/297] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:40.694485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.694883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.695245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.712062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:40.713425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:40.734368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c97c9-daa1-4ceb-b1a6-546abe701dfa None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:40.769650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:40.770605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.771349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.771630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.785838 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:40.789312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 157/298] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:40.793471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:40.795003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 142/299] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:40.801543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:40.810210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:40.901729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33480902-e232-4533-9c33-c193c60b3dfa None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:40.911096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e5a9-6570-44ed-bb09-dedc4a08f4a2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:40.936244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:40.936927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.937219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.937482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.938224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:40.938521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:40.939894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:40.945792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:40.946604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:40.947153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:40.947433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:40.948669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:40.950166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:40.954092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 158/300] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:40.954970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:40.956418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 143/301] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:40.957257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:41.052113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5aca-3c9d-4914-b5d7-075ef4757437 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:41.084099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf89ea-d199-41a7-a082-48a18e74e1d6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:41.087062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:41.087947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.088220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.088486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] PATH_INFO: `/v3/users/accc1e24daa342e99cd26dce2f16b3a6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.102473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] RBAC: Authorizing `identity:get_user(user_id=accc1e24daa342e99cd26dce2f16b3a6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:41.103998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:41.110479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 159/302] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:40 2022] GET /identity/v3/users/accc1e24daa342e99cd26dce2f16b3a6 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:41.111407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:41.122496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed4c67-2083-447a-a7d9-551b381f1ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:41.123479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4c67-2083-447a-a7d9-551b381f1ae0 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.123767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4c67-2083-447a-a7d9-551b381f1ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.124311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed4c67-2083-447a-a7d9-551b381f1ae0 None admin] PATH_INFO: `/v3/groups` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.125045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed4c67-2083-447a-a7d9-551b381f1ae0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:41.127028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed4c67-2083-447a-a7d9-551b381f1ae0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:41.148097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 144/303] 10.222.0.30 () {60 vars in 1134 bytes} [Mon Apr 4 05:56:40 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:56:41.154855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af769d9d-47b8-4f82-8f68-23a0bb8b80bb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.155147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af769d9d-47b8-4f82-8f68-23a0bb8b80bb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.155412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af769d9d-47b8-4f82-8f68-23a0bb8b80bb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.157280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 145/304] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:41.164247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.164616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.165326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.190220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:41.191932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:41.227364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29cb1-e4f5-45b5-9380-801810e4e335 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:41.266085 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:41.266768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.267044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.267313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.268259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] RBAC: Adding query filter params (role.id=1d2250af682e430c9e12705f59c934b8, user.id=accc1e24daa342e99cd26dce2f16b3a6, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:41.268560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:41.270139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:41.281309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 160/305] 10.222.0.30 () {56 vars in 1308 bytes} [Mon Apr 4 05:56:41 2022] GET /identity/v3/role_assignments?user.id=accc1e24daa342e99cd26dce2f16b3a6&scope.system=all&role.id=1d2250af682e430c9e12705f59c934b8 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:41.407087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 146/306] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:41.430416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:41.533469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaef64-c689-4805-9326-a6c0b90f12e0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:41.567553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:41.568459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.568741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.569046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.579648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:41.587209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:41.588435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 161/307] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:41.594363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:41.701931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61449782-52ad-4cad-8791-268c6c31b091 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:41.736181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:41.737246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.737748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.738218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.739196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:41.740055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:41.741710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:41.751679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 147/308] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:41.758004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:41.861277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b271f-6487-4d0a-a695-9948a23aa4b8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:41.894468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2895f-3f2d-4687-8e47-9f13b65c955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:41.895408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2895f-3f2d-4687-8e47-9f13b65c955a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:41.895771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2895f-3f2d-4687-8e47-9f13b65c955a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:41.896052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2895f-3f2d-4687-8e47-9f13b65c955a None admin] PATH_INFO: `/v3/users/5aedc0ec1372442aa731824edeea01cc` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:41.897665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2895f-3f2d-4687-8e47-9f13b65c955a None admin] RBAC: Authorizing `identity:get_user(user_id=5aedc0ec1372442aa731824edeea01cc)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:41.899124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2895f-3f2d-4687-8e47-9f13b65c955a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:41.901064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 162/309] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:41 2022] GET /identity/v3/users/5aedc0ec1372442aa731824edeea01cc => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:41.906601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:42.007638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c84d9-7071-48fe-a3e0-0c8db2474d2c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:42.041546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f4f1a-d211-4b61-87b7-7e704e64ef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:42.042423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f4f1a-d211-4b61-87b7-7e704e64ef91 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.042707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f4f1a-d211-4b61-87b7-7e704e64ef91 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.042982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f4f1a-d211-4b61-87b7-7e704e64ef91 None admin] PATH_INFO: `/v3/system/users/5aedc0ec1372442aa731824edeea01cc/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.044557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f4f1a-d211-4b61-87b7-7e704e64ef91 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5aedc0ec1372442aa731824edeea01cc, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:42.046051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f4f1a-d211-4b61-87b7-7e704e64ef91 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:42.058464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 148/310] 10.222.0.30 () {58 vars in 1334 bytes} [Mon Apr 4 05:56:41 2022] PUT /identity/v3/system/users/5aedc0ec1372442aa731824edeea01cc/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:42.131933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6771a-0cfd-4071-a566-6a18638a1c9b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.132588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6771a-0cfd-4071-a566-6a18638a1c9b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.133154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6771a-0cfd-4071-a566-6a18638a1c9b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.135202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 163/311] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:42.141234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.141846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.142316 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.162114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:42.163898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:42.239298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 149/312] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:42.263246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6771a-0cfd-4071-a566-6a18638a1c9b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:42.365883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6771a-0cfd-4071-a566-6a18638a1c9b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:42.401929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:42.402738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.403016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.403288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.414315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:42.421800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:42.423481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 164/313] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:42.431542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:42.528335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde2a8b-72aa-48b9-8fcb-c6202057d189 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:42.562027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:42.563048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.563524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.563993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.564968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:42.565469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:42.567053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:42.575738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 150/314] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:42.581500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:42.679337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0204fa-5f02-41fe-b6e9-44fc48f97bad None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:42.713049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:42.714346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.714824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.715332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] PATH_INFO: `/v3/users/e7e1c6c75a2b47f69520e87298e5fda6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.716739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e1c6c75a2b47f69520e87298e5fda6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:42.718488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:42.720619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 165/315] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:42 2022] GET /identity/v3/users/e7e1c6c75a2b47f69520e87298e5fda6 => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:42.726350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:42.829120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d945-ea25-4c47-9c6b-ad16920b916d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:42.863197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:42.863854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:42.864136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:42.864522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:42.934064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:42.935546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:43.037339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 151/316] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:43.043036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:43.141419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93839-5486-443b-acc2-779be06b8174 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:43.174326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b14b-b940-43e7-952b-01cb07a1ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:43.175196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b14b-b940-43e7-952b-01cb07a1ce9f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.175480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b14b-b940-43e7-952b-01cb07a1ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.175756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b14b-b940-43e7-952b-01cb07a1ce9f None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.177420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9b14b-b940-43e7-952b-01cb07a1ce9f None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:43.178876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9b14b-b940-43e7-952b-01cb07a1ce9f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:43.180916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 166/317] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:43 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:43.186767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:43.299705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dece39-3619-460a-bbc0-f7e0adb8a640 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:43.334872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:43.335934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.336439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.336936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.337995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] RBAC: Adding query filter params (role.id=1d2250af682e430c9e12705f59c934b8, scope.project.id=ccf4263f55664a669e4c25514205b974, user.id=e7e1c6c75a2b47f69520e87298e5fda6) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:43.338539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:43.340233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ef67-a204-4c30-952b-29b38bffc0c8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:43.347451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 152/318] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:56:43 2022] GET /identity/v3/role_assignments?user.id=e7e1c6c75a2b47f69520e87298e5fda6&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=1d2250af682e430c9e12705f59c934b8 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:43.607622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2df79-889b-43cd-b2bd-13e1db61cfb8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.608003 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2df79-889b-43cd-b2bd-13e1db61cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.608175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2df79-889b-43cd-b2bd-13e1db61cfb8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.610143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 167/319] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:43.616129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.616309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc23f61-1e20-4c72-a4e1-b60e62e448c7 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.616501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc23f61-1e20-4c72-a4e1-b60e62e448c7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.616833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc23f61-1e20-4c72-a4e1-b60e62e448c7 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.617021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.617288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.618703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 168/320] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:43.623820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.624264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.624672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.636805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:43.638390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:43.641578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:43.642727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:43.708010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 153/321] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:43.709670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 169/322] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:43.732007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:43.732498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:43.830492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546c15-806e-4218-b34d-696b1bcb893d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:43.830828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe9a39-4d7f-40e1-ac1e-934208ceeab2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:43.866213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:43.866953 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.867402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.867679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.869507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:43.870370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:43.870646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:43.870910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:43.872060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:43.873534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:43.875462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 170/323] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:43.877637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:43.881302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:43.884710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:43.885958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 154/324] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:43.891659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:43.986849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed69200-770a-485f-bd5f-09c76d062ada None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:43.987049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe59c-9e2b-46bd-9c77-01da3a6cd473 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:44.021617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:44.022662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.022947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.023213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.023972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:44.024288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:44.025308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:44.025717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:44.025974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.026252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.026524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] PATH_INFO: `/v3/groups` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.027218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:44.028637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:44.034359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 155/325] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:44.040249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:44.048304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 171/326] 10.222.0.30 () {60 vars in 1134 bytes} [Mon Apr 4 05:56:43 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:56:44.162843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef36d47-485c-49ed-ba33-432383829e52 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:44.201066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070a05-b0d7-45d2-aa63-5fba183c0219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:44.201961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070a05-b0d7-45d2-aa63-5fba183c0219 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.202245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070a05-b0d7-45d2-aa63-5fba183c0219 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.202519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070a05-b0d7-45d2-aa63-5fba183c0219 None admin] PATH_INFO: `/v3/users/accc1e24daa342e99cd26dce2f16b3a6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.203816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61070a05-b0d7-45d2-aa63-5fba183c0219 None admin] RBAC: Authorizing `identity:get_user(user_id=accc1e24daa342e99cd26dce2f16b3a6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:44.205331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61070a05-b0d7-45d2-aa63-5fba183c0219 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:44.207248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 156/327] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:44 2022] GET /identity/v3/users/accc1e24daa342e99cd26dce2f16b3a6 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:44.213497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:44.322336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636afde0-54ef-4143-87ac-2be01a72345a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:44.360189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a40b4-567a-4366-bf1e-ebbec5fdfb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:44.361109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a40b4-567a-4366-bf1e-ebbec5fdfb9c None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.361387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a40b4-567a-4366-bf1e-ebbec5fdfb9c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.361655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a40b4-567a-4366-bf1e-ebbec5fdfb9c None admin] PATH_INFO: `/v3/system/users/accc1e24daa342e99cd26dce2f16b3a6/roles/1d2250af682e430c9e12705f59c934b8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.363211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a40b4-567a-4366-bf1e-ebbec5fdfb9c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=accc1e24daa342e99cd26dce2f16b3a6, role_id=1d2250af682e430c9e12705f59c934b8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:44.364715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a40b4-567a-4366-bf1e-ebbec5fdfb9c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:44.375486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 172/328] 10.222.0.30 () {58 vars in 1334 bytes} [Mon Apr 4 05:56:44 2022] PUT /identity/v3/system/users/accc1e24daa342e99cd26dce2f16b3a6/roles/1d2250af682e430c9e12705f59c934b8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:44.528360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd24541-343e-4752-b148-57dc887cdbf1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.528534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd24541-343e-4752-b148-57dc887cdbf1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.528826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd24541-343e-4752-b148-57dc887cdbf1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.530880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 157/329] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:44.536879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.537180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.537447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.557862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:44.559511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:44.628744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 173/330] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:44.653475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd24541-343e-4752-b148-57dc887cdbf1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:44.755989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd24541-343e-4752-b148-57dc887cdbf1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:44.792333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:44.792682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.793130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.793583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.805252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:44.812513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:44.814263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 158/331] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:44.820057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:44.932789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b029eba-cb94-450f-89b8-3129e3468737 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:44.968983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:44.969922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:44.970342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:44.970738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:44.971621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:44.972061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:44.973661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:44.982668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 174/332] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:44.987960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:45.089127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f17408-f4d9-4fe0-a6f3-74e2e8525bc7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:45.122840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15081b0b-c982-4d6d-a6bf-f210b10a4817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:45.123996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081b0b-c982-4d6d-a6bf-f210b10a4817 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:45.124495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081b0b-c982-4d6d-a6bf-f210b10a4817 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:45.124929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15081b0b-c982-4d6d-a6bf-f210b10a4817 None admin] PATH_INFO: `/v3/users/5aedc0ec1372442aa731824edeea01cc` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:45.126277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15081b0b-c982-4d6d-a6bf-f210b10a4817 None admin] RBAC: Authorizing `identity:get_user(user_id=5aedc0ec1372442aa731824edeea01cc)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:45.127857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15081b0b-c982-4d6d-a6bf-f210b10a4817 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:45.130168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 159/333] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:44 2022] GET /identity/v3/users/5aedc0ec1372442aa731824edeea01cc => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:45.138015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:45.245998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb16d0-7497-467a-9baf-1a6c6ffb3424 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:45.283964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:45.284916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:45.285355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:45.285766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:45.286947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] RBAC: Adding query filter params (role.id=f434d50ef8824d07bf4d2382f5470115, user.id=5aedc0ec1372442aa731824edeea01cc, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:45.287458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:45.289061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638d6b0-9203-4006-8ba2-7b92dc1290e8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:45.301949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 175/334] 10.222.0.30 () {56 vars in 1308 bytes} [Mon Apr 4 05:56:45 2022] GET /identity/v3/role_assignments?user.id=5aedc0ec1372442aa731824edeea01cc&scope.system=all&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:46.712380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a5a56-386b-4f92-bb64-bd418a300248 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:46.713440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a5a56-386b-4f92-bb64-bd418a300248 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:46.713937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a5a56-386b-4f92-bb64-bd418a300248 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:46.716407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 160/335] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:46.721803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:46.722659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:46.723250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:46.745686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:46.747262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:46.851488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 176/336] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:46.894369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a5a56-386b-4f92-bb64-bd418a300248 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:47.005790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a5a56-386b-4f92-bb64-bd418a300248 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:47.040150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96f680-bad5-4dc6-b3f5-161b81f9b9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:47.041362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96f680-bad5-4dc6-b3f5-161b81f9b9a7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.041834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96f680-bad5-4dc6-b3f5-161b81f9b9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.042324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96f680-bad5-4dc6-b3f5-161b81f9b9a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.059530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96f680-bad5-4dc6-b3f5-161b81f9b9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:47.066972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-7b96f680-bad5-4dc6-b3f5-161b81f9b9a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:47.068936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 161/337] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:47.074616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:47.153374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc19eb-58fe-4f11-8954-ea78b64a7ece None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.154033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc19eb-58fe-4f11-8954-ea78b64a7ece None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.154505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc19eb-58fe-4f11-8954-ea78b64a7ece None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.156523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 162/338] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:47.163303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.163885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.164385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.199677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:47.204381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:47.228503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee40b-d8be-42c3-84de-b8848653e12f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:47.311034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:47.311715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.311988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.312257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.313043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:47.313348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:47.314719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:47.330950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 177/339] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:47.336631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:47.361176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 163/340] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 04 05:56:47.386621 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:47.491496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aeda3-fd0c-4a0b-a736-bfdfd0666133 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:47.555262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e1d4-f2d5-4551-a97e-a19a3b0f6d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:47.556476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e1d4-f2d5-4551-a97e-a19a3b0f6d37 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.557313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e1d4-f2d5-4551-a97e-a19a3b0f6d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.557925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e1d4-f2d5-4551-a97e-a19a3b0f6d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.565185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c5c58-519f-4190-b9ca-14f396017269 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:47.616786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:47.618075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.618556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.619025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.634377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:47.642349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:47.649363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 164/341] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:47.655541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:47.704993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e1d4-f2d5-4551-a97e-a19a3b0f6d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:47.706479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e1d4-f2d5-4551-a97e-a19a3b0f6d37 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:47.778468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935271-c06a-42c2-8577-ed9c50c4b005 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:47.825121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:47.826184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.826677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.827145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.828100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:47.828600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:47.830226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b97d6-a2e0-401e-9426-0bdb074fa1f2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:47.840375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 165/342] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:47.842207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b9aa2-f50d-4f2b-87e9-2b0e5c181273 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.842710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b9aa2-f50d-4f2b-87e9-2b0e5c181273 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.843189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b9aa2-f50d-4f2b-87e9-2b0e5c181273 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.845407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 166/343] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:47.846365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b9aa2-f50d-4f2b-87e9-2b0e5c181273 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:47.953453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 178/344] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:47.954748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:47.955028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:47.955300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:47.990547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:47.991755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:48.029611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b9aa2-f50d-4f2b-87e9-2b0e5c181273 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.070588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 179/345] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:48.071438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.095112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9fffc-28e1-47d5-8e70-d830fdc63f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.095682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9fffc-28e1-47d5-8e70-d830fdc63f62 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.095955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9fffc-28e1-47d5-8e70-d830fdc63f62 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.096222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9fffc-28e1-47d5-8e70-d830fdc63f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.240793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9fffc-28e1-47d5-8e70-d830fdc63f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.242677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9fffc-28e1-47d5-8e70-d830fdc63f62 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.244125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef85ce-87d9-4dc7-9262-d181b893f07c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.282897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.283783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.284054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.284322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.285556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.287093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.289300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 180/346] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:48.289901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.346772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 167/347] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:48.348614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ff71-85c8-4c49-96b9-3a996c18d850 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.349401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ff71-85c8-4c49-96b9-3a996c18d850 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.349870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ff71-85c8-4c49-96b9-3a996c18d850 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.351806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 168/348] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:48.352744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ff71-85c8-4c49-96b9-3a996c18d850 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.399234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27e78d-2e50-4ba9-bf3f-af19a5b2f0da None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.432302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.433330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.433648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.433916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.444356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:48.451745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:48.453107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 181/349] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:48.453910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.462476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ff71-85c8-4c49-96b9-3a996c18d850 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.518680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a66952-23a5-4fa1-a0ed-07d6ae77dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.519556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66952-23a5-4fa1-a0ed-07d6ae77dcbb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.519826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66952-23a5-4fa1-a0ed-07d6ae77dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.520091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66952-23a5-4fa1-a0ed-07d6ae77dcbb None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.530720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a66952-23a5-4fa1-a0ed-07d6ae77dcbb None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.532184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a66952-23a5-4fa1-a0ed-07d6ae77dcbb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.534174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 169/350] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:48.535368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.535699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.536006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.553205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:48.554384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:48.579667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9320e4-9269-4bfb-af04-c57a1083e5c9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.614895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.616119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.616599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.617092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.618505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.620439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.621458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 170/351] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:48.622359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.623015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 182/352] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:48.623967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.722290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628202-a09d-412d-8868-b7264d5900f4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.722484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cff9c9-4133-4325-95f3-8af4cce97da1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.756605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.757753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.758306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.758711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.759005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.759398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.759676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.759944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.760636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=a1fb1b92ff18438caab069f229ad3f71) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:48.760736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:48.761060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.761446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.762465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.763263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.769250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 183/353] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 260 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:48.770376 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.773043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 171/354] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:48.773941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.875222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb5576-fb99-4251-b326-8dbe282f79f2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.896965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9785-73c4-41dd-a5ae-eecff5258dd8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:48.911576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.912639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.913051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.913418 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.914693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:48.916215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:48.917992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 184/355] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:48.918854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:48.937713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:48.938800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:48.939276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:48.939717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:48.951963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:48.960194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 04 05:56:48.962137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 172/356] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:48.963152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.029075 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5ef67-7fec-41a9-9137-f49670c7072f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.062887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c00b-92d2-471f-91fb-24bc4dfe6e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.063573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c00b-92d2-471f-91fb-24bc4dfe6e93 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.064048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c00b-92d2-471f-91fb-24bc4dfe6e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.064503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c00b-92d2-471f-91fb-24bc4dfe6e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.073275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c2dcf-eecc-46ef-a236-059ba8f821b7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.110878 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.111955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.112451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.112948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.114362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=a1fb1b92ff18438caab069f229ad3f71) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:49.115188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.117096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.124421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 173/357] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.125732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.138817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123c00b-92d2-471f-91fb-24bc4dfe6e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.140563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123c00b-92d2-471f-91fb-24bc4dfe6e93 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.243833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6be3-bdfb-4bcf-a11c-b3bc4693fe40 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.249566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 185/358] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:49.250946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75959-e432-4dac-8fa7-014b67ff8a96 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.251219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75959-e432-4dac-8fa7-014b67ff8a96 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.251487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75959-e432-4dac-8fa7-014b67ff8a96 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.253255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 186/359] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:49.263087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.263598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.264000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.283294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:49.284730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:49.288695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.289591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.290089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.290573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.291540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:49.292064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.293712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.303901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 174/360] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.305139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.356675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 187/361] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:49.357769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.414954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861934-1081-4b65-8d85-ef26d1c14521 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.451897 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.453221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.453701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.454167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.455642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.457346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.457632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce953bce-a058-4710-bbd1-cb2b3ddd964c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.460256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 175/362] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.461343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.492653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.493870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.494288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.494692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] PATH_INFO: `/v3/users/accc1e24daa342e99cd26dce2f16b3a6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.496143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] RBAC: Authorizing `identity:get_user(user_id=accc1e24daa342e99cd26dce2f16b3a6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.497853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.500038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 188/363] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/users/accc1e24daa342e99cd26dce2f16b3a6 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.501006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.580113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001d3a-5735-470c-9dd6-3f144a7ac63c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.614189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfad3e-2f4f-47bc-bb97-fc3d1b744482 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.617586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.618571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.618856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.619129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.630280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:49.638243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:49.640051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 176/364] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:49.640580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.651476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.652685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.653184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.653640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.654993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.656608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.658737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 189/365] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.659734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.746375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc352b-c373-4262-add9-859ea229fd46 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.761436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee8df-ebe1-4e82-93c1-3a1a102e72c9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.781504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.782164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.782443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.782714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.783555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] RBAC: Adding query filter params (role.id=1d2250af682e430c9e12705f59c934b8, user.id=accc1e24daa342e99cd26dce2f16b3a6, scope.system=all) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:49.783864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.785339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.797556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.798551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.798942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 177/366] 10.222.0.30 () {56 vars in 1308 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/role_assignments?user.id=accc1e24daa342e99cd26dce2f16b3a6&scope.system=all&role.id=1d2250af682e430c9e12705f59c934b8 => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.799215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.799681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.799841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.800893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:49.801435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.803069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.813063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 190/367] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.822026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:49.928151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff22a8-443e-4964-81ed-07cffc8305ae None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.969034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:49.969682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.969961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.970237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.971076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=ccf4263f55664a669e4c25514205b974) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:49.971390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:49.972845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a9c61-9163-4cea-bec1-9fea14780d73 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:49.977118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b7a2-8b21-4c1c-9585-c6cfa91c724a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:49.979310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 178/368] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:49.989242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb38b-5552-4427-8bd5-27f7bd0498e1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.989882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb38b-5552-4427-8bd5-27f7bd0498e1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.990458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb38b-5552-4427-8bd5-27f7bd0498e1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:49.992921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 179/369] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:49.998531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:49.999030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:49.999428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.025786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:50.027347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:50.036811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.038199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.038716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.039169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.124147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:50.127783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:50.132077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 180/370] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:50.177740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:50.244470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 191/371] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:50.250307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:50.324278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5856ed-13f8-4798-8f1c-4201a53d0a7d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:50.370768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.372067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.372067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.372246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.387513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bae28-054c-4785-91f6-5e05c1123440 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:50.388235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:50.399998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:50.401561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 181/372] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:50.407158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:50.425195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81078329-44e8-4916-905b-a100924a2088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.426457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81078329-44e8-4916-905b-a100924a2088 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.426944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81078329-44e8-4916-905b-a100924a2088 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.427400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81078329-44e8-4916-905b-a100924a2088 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.428805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81078329-44e8-4916-905b-a100924a2088 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:50.430468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81078329-44e8-4916-905b-a100924a2088 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:50.432695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 192/373] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:50 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:50.438406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81078329-44e8-4916-905b-a100924a2088 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:50.532354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074255-a26a-4da0-bcfd-1c488070001e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:50.542596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81078329-44e8-4916-905b-a100924a2088 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:50.567426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.568508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.568794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.569098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.569853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:50.570157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:50.571540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:50.578438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.579590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.579935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 182/374] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:50.580270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.580722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.582141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:50.584063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:50.585931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 193/375] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:50 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:50.586034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:50.593566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:50.748839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad545e08-6512-4b8e-8410-676e0e0b423e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:50.766400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9163-7ac8-4227-ae34-32b94713be46 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:50.788198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.791229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.791710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.792190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.793280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=ccf4263f55664a669e4c25514205b974) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:50.793777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:50.795447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:50.801904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 194/376] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:50 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:50.819515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:50.820604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:50.821092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:50.821551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:50.940777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:50.942498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:51.071372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 183/377] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:51.077155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:51.228925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87fa6-f50e-4d1a-b8a9-66e7241413dc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:51.263064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:51.264305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:51.264817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:51.265292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] PATH_INFO: `/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:51.266709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] RBAC: Authorizing `identity:get_project(project_id=f13bc56bb56c4dff9db8451a514a4fb8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:51.268376 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:51.270705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 195/378] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:51 2022] GET /identity/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:51.276606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:51.400557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b331-3653-4c3d-9d09-3644558179cc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:51.440370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1734b-3259-44ae-a369-b02f2099b7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:51.441266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1734b-3259-44ae-a369-b02f2099b7eb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:51.441545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1734b-3259-44ae-a369-b02f2099b7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:51.441822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1734b-3259-44ae-a369-b02f2099b7eb None admin] PATH_INFO: `/v3/groups/5dd91c65db5346e885995c9b0723a834` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:51.449570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1734b-3259-44ae-a369-b02f2099b7eb None admin] RBAC: Authorizing `identity:get_group(group_id=5dd91c65db5346e885995c9b0723a834)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:51.451049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1734b-3259-44ae-a369-b02f2099b7eb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:51.453122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 184/379] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:51 2022] GET /identity/v3/groups/5dd91c65db5346e885995c9b0723a834 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:51.458807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:51.607535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea33908-0def-43da-a01a-7ec761ba58cf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:51.646919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:51.648337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:51.648816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:51.649296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:51.650327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] RBAC: Adding query filter params (group.id=5dd91c65db5346e885995c9b0723a834, role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=f13bc56bb56c4dff9db8451a514a4fb8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:51.650875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:51.652509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9cd8-a0eb-4883-8387-3e15f2165fee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:51.661500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 196/380] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:51 2022] GET /identity/v3/role_assignments?group.id=5dd91c65db5346e885995c9b0723a834&scope.project.id=f13bc56bb56c4dff9db8451a514a4fb8&role.id=5fd8ee302a3344489bda8c045d41beba => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:52.056635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed1b0-8cc3-49e4-b263-3d63cf95bd54 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.057154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed1b0-8cc3-49e4-b263-3d63cf95bd54 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.057250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ed1b0-8cc3-49e4-b263-3d63cf95bd54 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.059503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 185/381] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:52.065081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.065689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.066170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.089149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:52.091155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:52.170257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 197/382] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:52.196529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed1b0-8cc3-49e4-b263-3d63cf95bd54 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:52.323849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ed1b0-8cc3-49e4-b263-3d63cf95bd54 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:52.368016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee5daa-be73-4cd9-9992-a7fee27e1687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:52.369244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee5daa-be73-4cd9-9992-a7fee27e1687 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.369734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee5daa-be73-4cd9-9992-a7fee27e1687 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.370188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee5daa-be73-4cd9-9992-a7fee27e1687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.389793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee5daa-be73-4cd9-9992-a7fee27e1687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:52.398231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-01ee5daa-be73-4cd9-9992-a7fee27e1687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:52.399990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 186/383] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:52.405576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:52.570341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f6a5-9d4a-45ac-8729-a4e23be0ca60 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:52.588944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed3af-3f00-40d3-8a49-7e1a396f7050 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.589544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed3af-3f00-40d3-8a49-7e1a396f7050 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.590026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feed3af-3f00-40d3-8a49-7e1a396f7050 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.592225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 187/384] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:52.600853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.601154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.601656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.624868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:52.625582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.625862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.626136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.626917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:52.627196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:52.628240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:52.628581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:52.630046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:52.644279 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 198/385] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:52.651667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:52.733522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 188/386] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:52.768937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:52.814482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6321887-eeef-4eb7-833f-a014c2445c25 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:52.879886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:52.880760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:52.881061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:52.881330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:52.882657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:52.884110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:52.886056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 199/387] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:52 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:52.891569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:52.961347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea53d-55a7-4771-8b29-dbf0de7fa716 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:52.999533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df1c6f-97ee-49a7-bb50-c741bdf2868a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.034498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.035899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.036332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.036840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.038214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:53.039881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.040103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:53.040933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.041307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.041673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.042872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 200/388] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:52 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:53.048593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.067855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:53.084291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:53.086015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 189/389] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:53.091259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.149980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dbb09-4ce1-4708-a09b-78d8df379a8b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.193671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.194830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.195273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.195679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71/groups/09e04d005c4f45d39dbce61bf899cb97/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.197950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] RBAC: Authorizing `identity:create_grant(project_id=a1fb1b92ff18438caab069f229ad3f71, group_id=09e04d005c4f45d39dbce61bf899cb97, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:53.199553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:53.226827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a8f25-5033-4cf4-8b84-a168b9419e0d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.227237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 201/390] 10.222.0.30 () {58 vars in 1442 bytes} [Mon Apr 4 05:56:53 2022] PUT /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71/groups/09e04d005c4f45d39dbce61bf899cb97/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 05:56:53.273494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.274250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.274531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.274800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.275576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:53.275883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:53.277328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82370200-176d-45c4-9dde-decf3c1000c1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:53.293500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 190/391] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:53.299830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.405407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddd5ac-7895-494e-a338-08693ebd4455 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.405597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddd5ac-7895-494e-a338-08693ebd4455 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.405866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddd5ac-7895-494e-a338-08693ebd4455 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.407699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 191/392] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:53.414195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.414490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.414757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.418753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ad62d-46e3-4df9-9c32-99c8ef8b340f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.449509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:53.450740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:53.455630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.456845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.457288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.457783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.459171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:53.460803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:53.462985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 202/393] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:53 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:53.468045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.573540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 192/394] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:53.597934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91874ce-4ecc-4a23-bc60-9449609f9cbe None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.602343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.636466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.637664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.638101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.638509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.639885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:53.641508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:53.643655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 203/395] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:53 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:53.650505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.769495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d765b-71ad-4180-844a-145e79261647 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.794118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b962-0f5c-41e8-9964-993094bd590b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:53.816149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deffe7f-c264-4414-aab1-ceb6667a22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.817215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deffe7f-c264-4414-aab1-ceb6667a22a7 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.817492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deffe7f-c264-4414-aab1-ceb6667a22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.817761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deffe7f-c264-4414-aab1-ceb6667a22a7 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71/groups/09e04d005c4f45d39dbce61bf899cb97/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.819994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deffe7f-c264-4414-aab1-ceb6667a22a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1fb1b92ff18438caab069f229ad3f71, group_id=09e04d005c4f45d39dbce61bf899cb97, role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:53.821482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deffe7f-c264-4414-aab1-ceb6667a22a7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:53.836458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:53.837304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.838008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.838008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.848506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 204/396] 10.222.0.30 () {58 vars in 1442 bytes} [Mon Apr 4 05:56:53 2022] PUT /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71/groups/09e04d005c4f45d39dbce61bf899cb97/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:53.849640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec740-996f-4c7b-9951-2010a326d0e4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.849922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec740-996f-4c7b-9951-2010a326d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.850190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec740-996f-4c7b-9951-2010a326d0e4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.856076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 205/397] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:53.864198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:53.870492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:53.870852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:53.871029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:53.873101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:53.875772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 193/398] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:53.885654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:53.909216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:53.910457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:54.006820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdcb36-b1cf-4ca5-9318-bdf738392f20 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.051455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.054383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.054960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.056797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.057925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:54.058590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.060388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.070992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 206/399] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:54.075342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 194/400] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:54.080783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.100367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.210118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efad9d6-b026-4d2e-949b-a162ce45dec6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.233629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801464cf-52dc-48ae-abda-dc16e5d5fc56 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.250175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.251222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.251416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.251688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.253805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.255846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.257974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 207/401] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:54 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:54.263440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.280258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.281114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.281439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.281710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.293529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:54.302590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:54.305126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 195/402] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:54.311035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.389139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2915f-8934-4d16-acc5-d0564ef00640 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.426337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.427326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.427607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.427868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.431426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.433491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.435631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 208/403] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:54 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:54.436178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03cba-0af2-4795-9500-8110db7c6959 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.441670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.478439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.479164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.479435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.479703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.480462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:54.480759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.482216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.491278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 196/404] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:54.497384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.611513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34c57-0a0f-46b2-9860-691e8011c209 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.658167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570862e8-884c-405f-8b71-8b37d507ad41 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.663837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.664729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.665032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.665294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974/groups/09e04d005c4f45d39dbce61bf899cb97/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.669655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf4263f55664a669e4c25514205b974, group_id=09e04d005c4f45d39dbce61bf899cb97, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.671109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.691741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 209/405] 10.222.0.30 () {58 vars in 1442 bytes} [Mon Apr 4 05:56:54 2022] PUT /identity/v3/projects/ccf4263f55664a669e4c25514205b974/groups/09e04d005c4f45d39dbce61bf899cb97/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:54.713030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe59b9-634e-4950-99b5-b92edffb2c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.713979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe59b9-634e-4950-99b5-b92edffb2c55 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.714253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe59b9-634e-4950-99b5-b92edffb2c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.714524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe59b9-634e-4950-99b5-b92edffb2c55 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.721950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe59b9-634e-4950-99b5-b92edffb2c55 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.723735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe59b9-634e-4950-99b5-b92edffb2c55 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.726006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 197/406] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:54 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:54.731985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.874409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912e6b-93db-49be-9ef1-db6f24da528c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:54.884811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812c75-9af0-4e26-bcb3-3e5dd482913b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.885140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812c75-9af0-4e26-bcb3-3e5dd482913b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.885412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0812c75-9af0-4e26-bcb3-3e5dd482913b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.887452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 198/407] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:54.892316 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.892595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.892867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.919118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:54.920011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:54.920288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:54.920560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:54.921959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:54.923425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:54.925759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 210/408] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:54 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:54.931611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:54.934031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:54.935256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:55.038606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 199/409] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:55.050448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b802-ed72-45a4-8fd9-c460b8d983ba None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:55.063038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:55.089708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:55.090921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:55.091449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:55.091725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974/groups/09e04d005c4f45d39dbce61bf899cb97/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:55.094607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf4263f55664a669e4c25514205b974, group_id=09e04d005c4f45d39dbce61bf899cb97, role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:55.096262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:55.114948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 211/410] 10.222.0.30 () {58 vars in 1442 bytes} [Mon Apr 4 05:56:54 2022] PUT /identity/v3/projects/ccf4263f55664a669e4c25514205b974/groups/09e04d005c4f45d39dbce61bf899cb97/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:55.194393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c4a3-dc44-491f-9b98-a4c0a8753e47 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:55.232873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:55.233725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:55.234000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:55.234267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:55.247045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:55.254096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:55.256380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 200/411] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:55.262356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:55.387523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc5ade-8526-4391-b05f-f2b2fbbea801 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:55.426119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:55.426822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:55.427108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:55.427453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:55.428206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:55.428503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:55.429939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:55.438971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 212/412] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:55.445379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:55.591884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c573-6eba-4861-ad69-e9d758817960 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:55.630309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:55.631172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:55.631449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:55.631795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] PATH_INFO: `/v3/groups/5dd91c65db5346e885995c9b0723a834` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:55.633145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd91c65db5346e885995c9b0723a834)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:55.634600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:55.636536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 201/413] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:55 2022] GET /identity/v3/groups/5dd91c65db5346e885995c9b0723a834 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:55.641915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:55.790627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c6562-3fb3-4188-9236-05ad89c19b28 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:55.835689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a6ed2-66f5-40ba-8dff-2817f907f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:55.836593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6ed2-66f5-40ba-8dff-2817f907f14e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:55.836877 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6ed2-66f5-40ba-8dff-2817f907f14e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:55.837265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6ed2-66f5-40ba-8dff-2817f907f14e None admin] PATH_INFO: `/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:55.838537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a6ed2-66f5-40ba-8dff-2817f907f14e None admin] RBAC: Authorizing `identity:get_project(project_id=f13bc56bb56c4dff9db8451a514a4fb8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:55.844991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a6ed2-66f5-40ba-8dff-2817f907f14e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:55.847215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 213/414] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:55 2022] GET /identity/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:55.853972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:56.010922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c30f-bad2-4d3c-89c7-160fc2d7b6a1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:56.050909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118afce-1fb6-499e-b1d9-56c2e0b8d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:56.051824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118afce-1fb6-499e-b1d9-56c2e0b8d4be None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:56.052126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118afce-1fb6-499e-b1d9-56c2e0b8d4be None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:56.052490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118afce-1fb6-499e-b1d9-56c2e0b8d4be None admin] PATH_INFO: `/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8/groups/5dd91c65db5346e885995c9b0723a834/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:56.058223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118afce-1fb6-499e-b1d9-56c2e0b8d4be None admin] RBAC: Authorizing `identity:create_grant(project_id=f13bc56bb56c4dff9db8451a514a4fb8, group_id=5dd91c65db5346e885995c9b0723a834, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:56.059688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118afce-1fb6-499e-b1d9-56c2e0b8d4be None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:56.083336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 202/415] 10.222.0.30 () {58 vars in 1442 bytes} [Mon Apr 4 05:56:55 2022] PUT /identity/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8/groups/5dd91c65db5346e885995c9b0723a834/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:56:56.221621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53386a-d9f3-4397-93aa-32f1d8133cd3 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:56.222016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53386a-d9f3-4397-93aa-32f1d8133cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:56.222187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53386a-d9f3-4397-93aa-32f1d8133cd3 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:56.225073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 214/416] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:56.230546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:56.231027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:56.231125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:56.252033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:56.257396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:56.351672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 203/417] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:56.375716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53386a-d9f3-4397-93aa-32f1d8133cd3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:56.487839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53386a-d9f3-4397-93aa-32f1d8133cd3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:56.523066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:56.523870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:56.524142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:56.524445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:56.534859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:56.542040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:56.543593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 215/418] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:56.549391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:56.698430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668a37-62b9-4447-b7b4-82d2b0a9e8b0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:56.742101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:56.742789 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:56.743068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:56.743340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:56.744103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:56.744404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:56.745828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921aafe-92f2-4d41-a499-d2e770170ab2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:56.761916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 204/419] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:56.767892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:56.912627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dcee9-8fd4-48ef-9213-6ef7281394d4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:56.959078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:56.959645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:56.959920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:56.960186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.044308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:57.045792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:57.127745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471986-9be7-420f-8598-7687ff7ace41 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.128073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471986-9be7-420f-8598-7687ff7ace41 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.128300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26471986-9be7-420f-8598-7687ff7ace41 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.130429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 205/420] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:57.137876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.138189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.138439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.156402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 216/421] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:57.162133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:57.181963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:57.184142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:57.304627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 206/422] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:57.314659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501797-46bf-4ee0-8416-1916c3047352 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:57.334440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:57.366952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:57.367827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.368103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.368373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.370194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:57.371645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:57.373361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 217/423] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:57 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:56:57.379093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:57.481867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d085f-7454-4daa-99a4-96e0cbe431ff None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:57.525772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:57.526617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.526897 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.527170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.548594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:57.559697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:57.563764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 207/424] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:57.570789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b9cef-c171-4a9a-994f-04e7e1b351b2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:57.573486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:57.630268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:57.634349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.636061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.636759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.643683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:57.645618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:57.648305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 218/425] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:57 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:57.654383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:57.767116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543cd1f-9775-48c8-b305-655b56bdaa07 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:57.811793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:57.812395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.812708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.813188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.813961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:57.814271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:57.815683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:57.828260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa47c05-46ea-4378-bca2-0d776babd917 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:57.837850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 208/426] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:57.838745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:57.895522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:57.896191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:57.896473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:57.896746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:57.899779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=a1fb1b92ff18438caab069f229ad3f71) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:57.900096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:57.901585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78d47-2e10-4c04-80c9-670893bc8528 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:57.919570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 219/427] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:57 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 611 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:57.978007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e927b-a5c1-46f3-8960-03c4116592be None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.013998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.014654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.014934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.015208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.071860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c7fc-b875-4bd2-b6fd-3566ce3ac8eb None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.072460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c7fc-b875-4bd2-b6fd-3566ce3ac8eb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.072965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c7fc-b875-4bd2-b6fd-3566ce3ac8eb None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.074964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 220/428] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:56:58.080505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.081115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.081580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.087209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:58.088698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:58.122066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:58.123643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:58.193011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 209/429] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:58.202520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.266545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 221/430] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:56:58.295126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.341799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfea23-73a8-486e-bcd0-69aa19510220 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.381814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77543e-e6c1-404b-9c41-41bf532039d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.383030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77543e-e6c1-404b-9c41-41bf532039d0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.383536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77543e-e6c1-404b-9c41-41bf532039d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.383992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77543e-e6c1-404b-9c41-41bf532039d0 None admin] PATH_INFO: `/v3/projects/a1fb1b92ff18438caab069f229ad3f71` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.385396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77543e-e6c1-404b-9c41-41bf532039d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a1fb1b92ff18438caab069f229ad3f71)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:58.387036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77543e-e6c1-404b-9c41-41bf532039d0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:58.389252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 210/431] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/projects/a1fb1b92ff18438caab069f229ad3f71 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:58.390666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57be7-5b1e-4df1-9378-d5c961be2e1b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.395387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57be7-5b1e-4df1-9378-d5c961be2e1b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.396087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57be7-5b1e-4df1-9378-d5c961be2e1b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.398799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 211/432] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:58.399809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57be7-5b1e-4df1-9378-d5c961be2e1b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.404287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5cbb5-f914-42e9-974b-85f734e00ec5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.440235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5482944-f607-4b9a-ad80-60813fc015c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.441140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5482944-f607-4b9a-ad80-60813fc015c5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.441420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5482944-f607-4b9a-ad80-60813fc015c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.441816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5482944-f607-4b9a-ad80-60813fc015c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.456935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5482944-f607-4b9a-ad80-60813fc015c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:58.466616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-b5482944-f607-4b9a-ad80-60813fc015c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:56:58.466616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 222/433] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:56:58.467823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.468016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.468284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.486849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:58.488047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:58.524113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57be7-5b1e-4df1-9378-d5c961be2e1b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.562512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.563381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.563661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.564733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.568162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:58.568162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:58.571014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 212/434] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:58.571014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.575653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 223/435] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:58.577584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.683640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34b8d2-d073-4e1d-b489-d54ad58b7514 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.686746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefb7b0-8e81-41d1-aae2-93013f15b8f9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.716441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.717125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.717400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.717673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.718493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=a1fb1b92ff18438caab069f229ad3f71) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:58.718797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:58.720219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:58.721612 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.722280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.722556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.722832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.723723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:58.724174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:58.725582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:58.726534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 224/436] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=a1fb1b92ff18438caab069f229ad3f71&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:58.727474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.747237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 213/437] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:58.755083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.842397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75647011-0d50-4346-b99f-1be1edcc43d9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.881270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.882086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.882363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.882630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:58.890155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c918ffa-174a-491b-a276-f788efec9a72 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:58.894224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:58.901736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 04 05:56:58.903297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 225/438] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:58.908640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:58.938172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d438e-72bd-4d07-ab6b-bcabbc936bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:58.939361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d438e-72bd-4d07-ab6b-bcabbc936bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:58.939968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d438e-72bd-4d07-ab6b-bcabbc936bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:58.940435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d438e-72bd-4d07-ab6b-bcabbc936bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.013784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d438e-72bd-4d07-ab6b-bcabbc936bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.015250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d438e-72bd-4d07-ab6b-bcabbc936bd9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.022565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68869-e3c9-4a1a-9fe2-ddd715f87e26 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.058290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.058962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.059240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.059506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.060250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:59.060547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.061953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa072d-5dfd-4993-803e-3f7f9c1fecf5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.070468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 226/439] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.073591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b169edf-ee31-433d-9924-b4f55eadeebf None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.073591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b169edf-ee31-433d-9924-b4f55eadeebf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.073591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b169edf-ee31-433d-9924-b4f55eadeebf None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.075990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 227/440] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:56:59.076780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b169edf-ee31-433d-9924-b4f55eadeebf None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.127015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 214/441] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 04 05:56:59.128417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.128780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.129216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.145988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:56:59.147858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:56:59.189189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b169edf-ee31-433d-9924-b4f55eadeebf None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.211701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 215/442] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:56:59.212543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.227638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.228533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.228820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.229114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.294716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.296170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.305849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331e80-9114-4c5e-a1d3-a94c1cffe64d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.339832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.340695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.341006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.341275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.342447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.343876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.350209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 216/443] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.350209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.391837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 228/444] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:56:59.392671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.446112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec915db-74a4-423d-8037-b1eb9b888076 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.478139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.478924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.479204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.479465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.486980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def85a-b77b-496c-917c-58f1ebc21ecc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.489373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:56:59.496226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:56:59.497443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 217/445] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:56:59.498195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.520564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.521459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.521736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.522373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.523539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.525007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.526639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 229/446] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.527365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.595973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5aa1de-c6b8-4124-814a-4b533a1960b7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.627159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292750dc-0cd0-416f-87ab-371287765a88 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.627568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.628533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.628814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.629239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] PATH_INFO: `/v3/projects/ccf4263f55664a669e4c25514205b974` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.630455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf4263f55664a669e4c25514205b974)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.631885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.633569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 218/447] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/projects/ccf4263f55664a669e4c25514205b974 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.634293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.661244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.662010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.662290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.662560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.663307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:59.663613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.665069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.673306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 230/448] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.674091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.731767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eeec5-f4cd-4fb0-b365-68a5ddff5636 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.763052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.763705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.763974 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.764241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.765095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=ccf4263f55664a669e4c25514205b974) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:59.765469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.766908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.768927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129791e-0adf-4f72-afb6-3791d9387862 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.772838 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 219/449] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.773648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.807834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.809319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.809865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.810311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] PATH_INFO: `/v3/groups/09e04d005c4f45d39dbce61bf899cb97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.811789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] RBAC: Authorizing `identity:get_group(group_id=09e04d005c4f45d39dbce61bf899cb97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.813461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.815407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 231/450] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/groups/09e04d005c4f45d39dbce61bf899cb97 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:56:59.822082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:56:59.899783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85fc50-7ca3-4914-8652-196675060331 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.926745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ca7a9-720f-45b0-bafa-f2be67741406 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:56:59.935718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.936352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.936629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.936930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.963858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:56:59.964513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:56:59.964792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:56:59.965084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:56:59.965911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] RBAC: Adding query filter params (group.id=09e04d005c4f45d39dbce61bf899cb97, role.id=f434d50ef8824d07bf4d2382f5470115, scope.project.id=ccf4263f55664a669e4c25514205b974) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:56:59.966940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:56:59.967666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:56:59.973869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 232/451] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/role_assignments?group.id=09e04d005c4f45d39dbce61bf899cb97&scope.project.id=ccf4263f55664a669e4c25514205b974&role.id=f434d50ef8824d07bf4d2382f5470115 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:00.020175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:00.021624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:00.135832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 220/452] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:00.141811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:00.243887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95715b-7c5c-4d8a-b360-5d563e7565d5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:00.278678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:00.279477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:00.279761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:00.280068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] PATH_INFO: `/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:00.281293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] RBAC: Authorizing `identity:get_project(project_id=f13bc56bb56c4dff9db8451a514a4fb8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:00.282726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:00.284383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 233/453] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:57:00 2022] GET /identity/v3/projects/f13bc56bb56c4dff9db8451a514a4fb8 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:00.292722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:00.398426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194155-1df5-463b-b919-bf938e46fbc4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:00.433793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075232e1-7c5d-46ab-955a-0b0366cd67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:00.434654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075232e1-7c5d-46ab-955a-0b0366cd67ed None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:00.434944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075232e1-7c5d-46ab-955a-0b0366cd67ed None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:00.435228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075232e1-7c5d-46ab-955a-0b0366cd67ed None admin] PATH_INFO: `/v3/groups/5dd91c65db5346e885995c9b0723a834` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:00.436431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075232e1-7c5d-46ab-955a-0b0366cd67ed None admin] RBAC: Authorizing `identity:get_group(group_id=5dd91c65db5346e885995c9b0723a834)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:00.437961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075232e1-7c5d-46ab-955a-0b0366cd67ed None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:00.444500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 221/454] 10.222.0.30 () {56 vars in 1180 bytes} [Mon Apr 4 05:57:00 2022] GET /identity/v3/groups/5dd91c65db5346e885995c9b0723a834 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:00.446032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:00.547896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816c0b3-b008-4d0b-9081-105bd3944718 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:00.581262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:00.581912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:00.582189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:00.582486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:00.583311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] RBAC: Adding query filter params (group.id=5dd91c65db5346e885995c9b0723a834, role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=f13bc56bb56c4dff9db8451a514a4fb8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:00.583618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:00.585079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7341ef-bd8e-446c-b732-6628cbbe762a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:00.590799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 234/455] 10.222.0.30 () {56 vars in 1376 bytes} [Mon Apr 4 05:57:00 2022] GET /identity/v3/role_assignments?group.id=5dd91c65db5346e885995c9b0723a834&scope.project.id=f13bc56bb56c4dff9db8451a514a4fb8&role.id=5fd8ee302a3344489bda8c045d41beba => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:03.264038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34bdc3-87a4-4dba-baa1-3feb22f99f15 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.264558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34bdc3-87a4-4dba-baa1-3feb22f99f15 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.264558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34bdc3-87a4-4dba-baa1-3feb22f99f15 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.266633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 222/456] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:03.274509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10816f5-119f-415c-ac2a-57c073d8cc56 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.274509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10816f5-119f-415c-ac2a-57c073d8cc56 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.274509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10816f5-119f-415c-ac2a-57c073d8cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.301008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a10816f5-119f-415c-ac2a-57c073d8cc56 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:03.302592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a10816f5-119f-415c-ac2a-57c073d8cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:03.383568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 235/457] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:03.418162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5c825-4c58-4a7c-9407-18b5475c0e10 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.418774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5c825-4c58-4a7c-9407-18b5475c0e10 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.419259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5c825-4c58-4a7c-9407-18b5475c0e10 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.421710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 223/458] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:03.427488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.427841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.428102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.430030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5c825-4c58-4a7c-9407-18b5475c0e10 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:03.453900 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:03.455096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:03.530437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 236/459] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:03.578586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5c825-4c58-4a7c-9407-18b5475c0e10 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:03.603626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:03.614627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:03.615436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.615715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.615986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.627340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:03.629208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:03.647725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:03.649576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 224/460] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:03.659222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:03.761144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62558a5c-a9b5-4216-9c86-f2bccf180bc4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:03.795750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:03.796867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.797428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.797882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.798558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3e30-6a14-4df4-bc75-2698f4e1ea01 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:03.809247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:03.811049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:03.832955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e6050d94-55de-4e17-a84b-33f3114c07da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:03.834827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 237/461] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:03.836615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd676a-57ed-42c0-b52f-a7346f7e9328 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.837228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd676a-57ed-42c0-b52f-a7346f7e9328 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.837670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd676a-57ed-42c0-b52f-a7346f7e9328 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.838548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:03.839279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.839873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.840214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.840671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 238/462] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:03.841612 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd676a-57ed-42c0-b52f-a7346f7e9328 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:03.845231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:03.846057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:03.848045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bac086-06f2-4f7a-a5f8-b5970327c1f0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:03.867304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 225/463] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:03.867304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:03.867304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:03.867304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:03.884529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:03.886045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:03.960986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 226/464] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:03.962069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:03.985558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd676a-57ed-42c0-b52f-a7346f7e9328 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.020587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.021567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.022358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.022796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.023659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:04.024092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.026671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.044304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 239/465] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:04.045484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:04.093820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3f38-a292-4200-8e53-d85c76c7a783 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.135600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.136529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.136985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.137392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.138697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.140737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.150265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edc49d-d409-4eac-a627-cd46ba521f93 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.182537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 227/466] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:57:03 2022] POST /identity/v3/users => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:04.184255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:04.190942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.191983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.192325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.192723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.205532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.207287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.227998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:04.229080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 240/467] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:04.235154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:04.314826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3e91a-d474-4da8-96e9-cd3955481c5c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.350160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db7ba-5431-448d-9918-0b06346844e6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.362115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329be011-e8aa-416b-b401-315f496c96b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.362907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be011-e8aa-416b-b401-315f496c96b3 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.363536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be011-e8aa-416b-b401-315f496c96b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.364140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be011-e8aa-416b-b401-315f496c96b3 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.365133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329be011-e8aa-416b-b401-315f496c96b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.367265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329be011-e8aa-416b-b401-315f496c96b3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.390438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.391642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.392216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.392734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.393616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 228/468] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:57:04 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:04.394071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:04.394866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.395381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6696c-0ed6-40a0-9bc4-17a0fddc5aba None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.395874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6696c-0ed6-40a0-9bc4-17a0fddc5aba None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.396211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6696c-0ed6-40a0-9bc4-17a0fddc5aba None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.397827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.398877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 229/469] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:04.410284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.410957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.412562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.431534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 241/470] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:04.442851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:04.449876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:04.451151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:04.527800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 230/471] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:04.554368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a021-e342-4ba5-b1ee-a7d465c20f6e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.559761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:04.595968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.597012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.597437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.597884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.598790 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.600638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.631291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 242/472] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:57:04 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:57:04.691924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933a4d8-ed8e-4b71-90ee-bbdf5674447f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.730449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.731269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.731644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.731918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.744273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.746029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.766955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:04.768670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 231/473] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:04.775517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:04.884345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190baf9-e224-4bbd-92e0-01a6a0a0e7be None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:04.918185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:04.918865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:04.919140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:04.919404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:04.920128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:04.920422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:04.921851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d6a00-aff4-4673-8ecc-5d8ae5be3c19 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:04.933818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 243/474] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:04.939403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:05.043161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c210-b616-4f2b-86fa-8cc6b090370a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:05.059604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254915-5cd6-42c7-9570-4ee08ffba634 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:05.059886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254915-5cd6-42c7-9570-4ee08ffba634 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:05.060148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254915-5cd6-42c7-9570-4ee08ffba634 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:05.064562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 244/475] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:05.068177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:05.068459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:05.068732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:05.088431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:05.089775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:05.089879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:05.090360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:05.090820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:05.091004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:05.091862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:05.093632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:05.133334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 232/476] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:57:04 2022] POST /identity/v3/users => generated 249 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:05.197221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 245/477] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:05.236090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:05.347205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df277fb-dfd5-4823-888f-d8a70bdd079b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:05.382625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:05.383616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:05.384086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:05.384525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:05.385487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:05.387097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:05.397613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.sql.core [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 04 05:57:05.397613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 04 05:57:05.397613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [parameters: {'id': 'cfaa62ce802c47bc916c487a423bf025', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 04 05:57:05.397613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79967) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 04 05:57:05.413455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 04 05:57:05.415625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 233/478] 10.222.0.30 () {60 vars in 1131 bytes} [Mon Apr 4 05:57:05 2022] POST /identity/v3/roles => generated 144 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:05.421716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:05.528117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa1883-f1f0-454d-aef4-d2331ab33ca5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:05.563948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceb7e4-e012-40e9-a12a-c0372d327281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:05.565112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceb7e4-e012-40e9-a12a-c0372d327281 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:05.565557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceb7e4-e012-40e9-a12a-c0372d327281 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:05.565988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceb7e4-e012-40e9-a12a-c0372d327281 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:05.578129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ceb7e4-e012-40e9-a12a-c0372d327281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:05.586190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-64ceb7e4-e012-40e9-a12a-c0372d327281 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 04 05:57:05.587987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 246/479] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:05.593767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:05.698632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889006d-8a97-4337-88d2-73462cf881f6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:05.735551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:05.736570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:05.737041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:05.737477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:05.738470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:05.738964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:05.740545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51e92-7c57-4dc1-b09d-07e4366e5f14 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:05.749615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 234/480] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:06.967947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecde0-9b77-42f1-819d-ecd9b7aca1f4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:06.968467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecde0-9b77-42f1-819d-ecd9b7aca1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:06.968467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecde0-9b77-42f1-819d-ecd9b7aca1f4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:06.970538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 247/481] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:06.976493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe6f3-54df-4dbe-97f9-4967abc5b431 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:06.976940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe6f3-54df-4dbe-97f9-4967abc5b431 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:06.977138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe6f3-54df-4dbe-97f9-4967abc5b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:06.998364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ff3fe6f3-54df-4dbe-97f9-4967abc5b431 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:06.999563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ff3fe6f3-54df-4dbe-97f9-4967abc5b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:07.094372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 235/482] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:07.121804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecde0-9b77-42f1-819d-ecd9b7aca1f4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.254920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecde0-9b77-42f1-819d-ecd9b7aca1f4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:07.288992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:07.289796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.290070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.290337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.300336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604f44-8118-4714-a3cc-947faccc3e1f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.300660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604f44-8118-4714-a3cc-947faccc3e1f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.300930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604f44-8118-4714-a3cc-947faccc3e1f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.303206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 236/483] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:07.303740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:07.308066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.308346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.308618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.316085 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:07.317910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 248/484] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:07.323852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.325337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:07.326502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:07.439293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 237/485] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:07.490771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585b4a-f5c3-40a4-99b0-f66a7dc0996f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:07.525144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.528251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:07.533278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.533568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.533836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.534598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:07.534897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:07.536636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:07.555396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 249/486] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:07.560454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.658023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165e4bd-9590-4ec4-8967-b9008a7aa808 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:07.691976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e9a9-35d5-4fc6-9035-6d299ccc18e8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:07.698663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d9771-96d4-4def-a891-2df045e0c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:07.699486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9771-96d4-4def-a891-2df045e0c004 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.700379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9771-96d4-4def-a891-2df045e0c004 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.700671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9771-96d4-4def-a891-2df045e0c004 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.714578 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d9771-96d4-4def-a891-2df045e0c004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:07.724597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-226d9771-96d4-4def-a891-2df045e0c004 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:07.726115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 238/487] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:07.730319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a40cd3-d806-4ce5-8832-071d9cd1aa39 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.730794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a40cd3-d806-4ce5-8832-071d9cd1aa39 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.731328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a40cd3-d806-4ce5-8832-071d9cd1aa39 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.733338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 239/488] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:07.734045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a40cd3-d806-4ce5-8832-071d9cd1aa39 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.734859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:07.735776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.736151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.736517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.748163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:07.749862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:07.767312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-10bd4e76-2991-4fc2-b751-6fbd16a74912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:07.769011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 250/489] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:07.770488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.770890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.771266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.788874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:07.790221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:07.857376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a40cd3-d806-4ce5-8832-071d9cd1aa39 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:07.860822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 251/490] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:07.861936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.904502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:07.905217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:07.905495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:07.905764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:07.906513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:07.906812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:07.908562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:07.919605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 240/491] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:07.920456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:07.973329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307ea15-5aec-4978-bf5b-3c7b198c7f3d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.008495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.009503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.010015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.010462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.011382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:08.011888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.013511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.026006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 252/492] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:08.027160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.050462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1be38-065e-4da5-aa68-7d16d1b8de22 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.083808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.084679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.084877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.085200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.095622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:08.102609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:08.104170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 241/493] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:08.104997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.137314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98cb00-5e5b-4468-86e5-1b79c7f2a0dd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.172950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.174177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.174695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.175158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.186549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.188364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.205940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:08.207568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7446b2-33c6-4078-b53a-8f671a51eb5b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.207967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 253/494] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:08.208954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.241372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.241866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.242141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.242410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.250541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.252013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.267166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:57:08.268770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 242/495] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:08.275818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.318848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca824e-c862-4af2-96b8-31a563955346 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.355026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.356107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.356620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.357109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.358080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:08.358598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.360172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.370289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 254/496] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:08.371517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.380640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6302e-1cc0-447c-8eed-d911dd04d5c6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.414613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.415116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.415390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.415658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.416372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:08.416671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.418091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.430409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 243/497] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:08.431238 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.478414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c73904-ab05-45f4-ad3a-21cb82e31ffe None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.512481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.513543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.514032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.514377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.515225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:08.515531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.517007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.528477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c893-48e9-41bc-9408-1b5c8ca80e84 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.553815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 255/498] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:08.554688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.564534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.565329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.565606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.565875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.576339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.577821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.594571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-d1a5ed90-55cb-4900-ae5c-5c24428b6641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:08.600555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 244/499] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:08.600555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b4974-b7ad-4d03-925d-5e04c844b060 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.600555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b4974-b7ad-4d03-925d-5e04c844b060 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.600555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b4974-b7ad-4d03-925d-5e04c844b060 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.600555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 245/500] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:08.600555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b4974-b7ad-4d03-925d-5e04c844b060 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.659438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfefc0-087b-44d1-8205-7f7bf71146fc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.691233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.692235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.692618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.692892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.698039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b4974-b7ad-4d03-925d-5e04c844b060 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.699700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.701180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.715035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 04 05:57:08.716226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 256/501] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:08.716964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.730124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341fad8-1c3e-41ef-9f74-6bf6716b5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.730814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fad8-1c3e-41ef-9f74-6bf6716b5a1f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.731081 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fad8-1c3e-41ef-9f74-6bf6716b5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.731345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341fad8-1c3e-41ef-9f74-6bf6716b5a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.795715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341fad8-1c3e-41ef-9f74-6bf6716b5a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.797159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341fad8-1c3e-41ef-9f74-6bf6716b5a1f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.821397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be472-8c20-4e89-974a-6a9fe6da6aa0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:08.855348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:08.856013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.856286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.856550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.857316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:08.857613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:08.858981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78189ff-4f52-4ca2-99b4-f58830ba3c7f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:08.870187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 257/502] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:08.871377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.871655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.871921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.887871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:08.889072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:08.899677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 246/503] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:08.901091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4655c-6546-4553-9648-e1f829cbf674 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:08.901428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4655c-6546-4553-9648-e1f829cbf674 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:08.901700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4655c-6546-4553-9648-e1f829cbf674 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:08.903331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 247/504] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:08.904380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4655c-6546-4553-9648-e1f829cbf674 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:08.956512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 258/505] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:08.957421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.006948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4655c-6546-4553-9648-e1f829cbf674 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.039427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.040097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.040377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.040695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.041578 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:09.041880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.043460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.055652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b3f0f-b3ea-48a8-b1dd-36e307b7334e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.079047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 248/506] 10.222.0.30 () {56 vars in 1137 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:09.079847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.088604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.089442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.089722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.089995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.097193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.098793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.112416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-75dbb268-9051-4037-ab1b-8be9df8ed82e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 04 05:57:09.113675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 259/507] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:09.114813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.115097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.115367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.131623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:09.132819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:09.174187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2443b9-a8f3-4d25-b508-d2c6ffa93dd1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.197931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 260/508] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:09.198729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.221951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.222788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.223040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.223337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.233358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.234821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.252259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:09.253486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 249/509] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:09.254359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.297036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef65927-e860-434b-9464-efc6d5b36e41 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.329136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.329859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.330133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.330395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.340386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:09.347377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:09.348522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 261/510] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:09.348650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cb605-bf2b-43f2-98e2-a479af755029 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.349270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.381141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.381784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.382069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.382341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.443058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593e043-ad42-485a-9c97-8e220d312797 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.450489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.451979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.474094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.474742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.475013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.475274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.476097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:09.476395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.477854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.497310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 262/511] 10.222.0.30 () {56 vars in 1137 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:09.497987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.548069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 250/512] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:09.548927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.603016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b978517-0001-42f2-98a8-1a75ec9c638e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.638342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.639128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.639398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.639660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.643568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10787104-af3c-4af0-ac01-45854b253090 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.649919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.651378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.668604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:09.669805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 263/513] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:09.670553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.679356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.680019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.680300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.680679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.681457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:09.681761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.683440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.695566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 251/514] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:09.696388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.765444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad555244-6a5b-4ed3-a053-2a946b9fee27 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.794419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c44f7b-1303-46b2-9374-397cbf480bb4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.800156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.800872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.801173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.801439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.802175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:09.802469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.803840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.812167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 264/515] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:09.812989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:09.832247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.833061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.833339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.833613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.903315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.904697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.908713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c6d2c-eaec-4df4-bf91-ddb79834ded5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:09.943273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:09.944095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:09.944369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:09.944639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:09.955291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:09.956728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:09.973594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:09.974755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 265/516] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:09.975508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.000981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 252/517] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:10.001917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.069054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bba707-69ae-43da-bda6-d247b4d3f030 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.098731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b546-99d2-4f45-989b-61ad49f578b0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.101797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.102455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.102737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.102995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.103703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:10.103996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.105404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.116783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 266/518] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:10.117587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.131846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.132652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.132925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.133234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.139767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.141283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.154696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:10.155788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 253/519] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:10.156542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.209855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817408ff-7a95-4418-86fa-f4e7faa1e95d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.241872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.242664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.242942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.243209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.250662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9576b6-bd67-4e6b-b7d9-a3ae9d62ff04 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.253272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.254777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.270737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:10.272264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 267/520] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:10.273040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.288473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.289256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.289599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.289875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.290600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:10.290900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.292284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.304353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 254/521] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:10.305142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.377721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b939-49cf-4cc3-a9a2-2edf4ff227ce None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.402201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dabc9-0c22-4f6d-a927-421907f7f514 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.409960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.410762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.410930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.411233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.421977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.423430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.438070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.438731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.439011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.439284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.439791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:10.439948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.441225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 268/522] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:10.441685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.442037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.462305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 255/523] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:57:10 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:10.462983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.545846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6b354-5c3e-47ca-970c-ba7c06be6d6f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.572689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4bf1-f38f-4d00-9d0a-bef3481d4a40 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.581398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.582141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.582437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.582689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.583588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:10.583902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.585404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.605273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 269/524] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:10.606170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.614894 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.615586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.615868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.616144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.616916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:10.617237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.618666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.632822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 256/525] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:10.634096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.720613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61b5c-d096-4c2c-83d2-a1899fb0d679 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.740736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4e228-2fe5-4e9b-89d1-0615e43846e4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.753750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.754602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.754895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.755161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.761791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.763256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.774312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.775185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.775601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.776007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.776566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:10.777056 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:10.777494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.777794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 270/526] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:10.778561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.779401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.797336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 257/527] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:10.797336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.888530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3041b-62f6-446d-8647-507cde6382dc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.895522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb3437-0c1a-4e89-884e-c1bb873bf628 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:10.920850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.921541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.921815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.922068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.922894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=07287811d9ef4e04bd62a665d642b61d) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:10.923199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.924772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.929276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:10.930109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:10.930377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:10.930653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:10.937408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 271/528] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/role_assignments?user.id=07287811d9ef4e04bd62a665d642b61d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:10.938739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:10.939330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:10.940868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:10.956157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 04 05:57:10.962700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 258/529] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:10.963707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.050316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963af542-f831-4d69-8124-8cf13bd6c41b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.075918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56c17d-6e35-4534-b66e-0aefed0185d2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.086550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.087956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.088450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.088956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.089950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:11.090517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.092235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.106198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 272/530] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:11.107438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.112340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.112853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.112853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.113229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.120751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.122353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.139663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:11.139663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 259/531] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:11.139663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.209333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa86eec-b71e-4031-9198-d6ff654edca3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.240109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5be545-e558-4c97-be50-c94de1cd69d8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.243605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.244434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.244806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.245250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.246201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:11.246598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.248524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.272156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 273/532] 10.222.0.30 () {56 vars in 1139 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:11.273250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.279620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.280294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.280577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.280849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.281722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=1e1cdcbf35ed49a1b130757f7230e5a7) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:11.282029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.283489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.289845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 260/533] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/role_assignments?user.id=1e1cdcbf35ed49a1b130757f7230e5a7&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:11.290656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.478402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432def2-414d-40d3-a88b-01674fc57fc8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.483667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869b22-94f9-4aa5-a18b-857fad1f06bf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.526739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.527397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.527673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.527944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.569615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.570302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.570585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.570862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.571667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:11.572160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.573642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.600605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.600801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 274/534] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:11.602236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.606843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.714395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 261/535] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:11.719549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:11.831437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ff1-23c6-4539-8e4e-388b2a9109be None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.849050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380b6fd-8b30-44f0-beba-9aa222d97a1a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:11.890270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.891074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.891349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.891617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.908785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:11.909466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:11.909824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:11.910103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:11.911565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.913045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.913584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=7f0640518ddc4893b20b6d79c80c21ed) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:11.913894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:11.915306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:11.928707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 275/536] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/role_assignments?user.id=7f0640518ddc4893b20b6d79c80c21ed&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:11.939038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:11.940741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 262/537] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:11.946565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:12.056568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee64548-d3f9-4ed5-8c7d-576a0d8c92d9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:12.102927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:12.103557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:12.103803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:12.104055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:12.104795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:12.105291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:12.106715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:12.124679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 276/538] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:12.125944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:12.255417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ca0e-56ba-42d6-9509-5dd49e96d02d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:12.291677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:12.292530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:12.292807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:12.293132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:12.299898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:12.301499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:12.314431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:12.315931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 263/539] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:12.321571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:12.433816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be156f79-80fd-4897-a7ae-7743a45aed8f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:12.472401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:12.473756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:12.474236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:12.474698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:12.475698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:12.476195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:12.477856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac006d-45dc-4c01-b334-47ce375c14f4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:12.490560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 277/540] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:12.496657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:12.620969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423204f-989f-4477-96f1-3200520cb129 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:12.654761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:12.655418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:12.655693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:12.655962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:12.656787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=6ada2f7acb1349e38b96dfbda5546101) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:12.657119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:12.658557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a000cd-4001-4163-b02d-ef71e32c8daf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:12.664719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 264/541] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:12 2022] GET /identity/v3/role_assignments?user.id=6ada2f7acb1349e38b96dfbda5546101&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:13.098721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a044d-b2ae-41e2-89ac-77f1e0708a50 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.099077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a044d-b2ae-41e2-89ac-77f1e0708a50 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.099272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a044d-b2ae-41e2-89ac-77f1e0708a50 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.101235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 278/542] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:13.106823 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.107359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.107848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.131043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:13.133058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:13.224051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 265/543] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:13.260412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a044d-b2ae-41e2-89ac-77f1e0708a50 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:13.414654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a044d-b2ae-41e2-89ac-77f1e0708a50 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:13.460558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:13.461398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.461677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.461955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.477998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:13.485077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:13.486470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 279/544] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:13.494768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:13.668537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208ad0-c3bf-48fc-bbb9-1bc7b5cf9f87 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:13.712285 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:13.712988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.713265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.713531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.714276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:13.714573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:13.715946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b739d4-3c25-4f48-a66f-034aa8130eb8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:13.724533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 266/545] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:13.730243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:13.791181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740debb-3b1f-4dca-87f7-cb8a7129ef53 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.791527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740debb-3b1f-4dca-87f7-cb8a7129ef53 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.791731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740debb-3b1f-4dca-87f7-cb8a7129ef53 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.793811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 267/546] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:13.798850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.799139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.799493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.834122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:13.835696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:13.909052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce84811-73f8-485d-8403-034d113c5adc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:13.962020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:13.963183 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:13.963818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:13.965366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:13.983334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 268/547] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:13.984681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:13.986407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.004059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:14.005960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 280/548] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:14.014027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.019853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.121292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f461b-5972-4fd7-9cc5-979ad55be91c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.156136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094674bc-ad6e-44f7-999c-f4facb084249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.157346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094674bc-ad6e-44f7-999c-f4facb084249 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.157824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094674bc-ad6e-44f7-999c-f4facb084249 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.158312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094674bc-ad6e-44f7-999c-f4facb084249 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.169118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094674bc-ad6e-44f7-999c-f4facb084249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:14.176612 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-094674bc-ad6e-44f7-999c-f4facb084249 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:14.178421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 281/549] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:14.179912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0ce5-fd44-4e83-8911-30db296e543d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.180389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0ce5-fd44-4e83-8911-30db296e543d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.180851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0ce5-fd44-4e83-8911-30db296e543d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.182881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d579ca-8f19-4d40-a74c-8d8e145a8143 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.183598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 282/550] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:14.184493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0ce5-fd44-4e83-8911-30db296e543d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.231458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.232199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.232479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.232749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.233501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:14.233802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.235784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca885272-f73b-4436-b808-2d2c7ab3c6b2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.251970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 269/551] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:14.253898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.254184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.254446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.277255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:14.278713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:14.296185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0ce5-fd44-4e83-8911-30db296e543d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.332273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.333463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.333945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.334470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.335459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:14.335958 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.337650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.346345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 283/552] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:14.347548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.364945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 270/553] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:14.364945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.463415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd73646-034a-48f6-9ce4-309fffe562aa None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.465360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e5324-0507-4abe-83c1-ad0e70f86349 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.496631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.497481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.497761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.498033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.499918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.500980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.501457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.501929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.508909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.510384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.511165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.512851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.527394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 04 05:57:14.528183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:14.529384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 284/554] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:14.529709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 271/555] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:14.530592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.539132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.630348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14ccc-9822-4fe9-a7c2-9f617e956301 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.638751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e22ac-9d2b-4f15-936e-2312b2b56ae0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.666684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.667837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.668318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.668753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.677562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.678186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.678470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.678743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.679583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:14.679893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.681355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe6d0-6813-4bcf-994e-aed8c76ff677 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.681460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:14.688551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:14.689975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 285/556] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:14.690722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.704265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 272/557] 10.222.0.30 () {56 vars in 1135 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:14.705851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48635539-a90b-4316-9c5a-bb092c7dc100 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.706296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48635539-a90b-4316-9c5a-bb092c7dc100 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.706998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48635539-a90b-4316-9c5a-bb092c7dc100 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.709381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 273/558] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:14.710257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48635539-a90b-4316-9c5a-bb092c7dc100 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.793655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d34ed-bae2-4447-bae5-ec06b4d3e2cb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.816191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48635539-a90b-4316-9c5a-bb092c7dc100 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.827917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.828578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.828850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.829140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.829850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:14.830152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.831533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.846864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 286/559] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:14.848017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.856118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.856797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.857111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.857387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.858144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:14.858451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:14.859854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921be74-3a39-4e37-a957-e60b76647faa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:14.868563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 274/560] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:14.869659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.869944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.870221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:14.886701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:14.887896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:14.950362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba9475-d4a8-4667-9d7c-c61e0e155fec None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:14.960922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 275/561] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:14.960922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:14.983750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:14.984399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:14.984669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:14.984940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.053781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.055168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.079892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1398f-964b-4f56-ad9b-1f7e896915d1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.114547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.115346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.115622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.115914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.122839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.124296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.137730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:57:15.138907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 276/562] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:15.139659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.160400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 287/563] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:15.160400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.239883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d829-c76d-4704-bb53-f44d8bd62dad None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.254960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1e797-8bd9-4fc7-9881-7f74275657b6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.274981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.275784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.276060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.276331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.287054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.288506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.291632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.292428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.292702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.293000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.303218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:15.305537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:15.311380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 277/564] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:15.311380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.311575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:15.316366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 288/565] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:15.317125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.409145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6346d-6007-46eb-8ced-c17bc7e5ea42 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.411947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575e1a6-6716-40ff-a4f9-e5343f846fce None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.443350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.443547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.444013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.444260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.444363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.444535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.444640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.444804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.445397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:15.445701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.447129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.455388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.456925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.463508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 278/566] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:15.464276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.473142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:15.474322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 289/567] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:15.475071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.566695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b232f4-62ed-4683-b1ad-5bc1294752aa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.568858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876f8fb-b5ca-46ab-a0c2-f85050d90b23 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.599854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.600359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.600519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.600795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.601043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.601187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.601342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.601583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.601840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:15.602139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.602296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:15.602592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.603623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0896-c109-4545-b6aa-5b3f6099624e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.605410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.612346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 290/568] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:15.614054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d08c7d-ec04-48c9-840e-a6414181a3fe None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.614337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d08c7d-ec04-48c9-840e-a6414181a3fe None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.614614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d08c7d-ec04-48c9-840e-a6414181a3fe None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.616554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 291/569] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:15.617675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d08c7d-ec04-48c9-840e-a6414181a3fe None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.625354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 279/570] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:15.626278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.718574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d08c7d-ec04-48c9-840e-a6414181a3fe None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.726185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177a52a-88f1-469c-8e9f-a073dc9df42f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.752555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.753467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.753717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.754025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.758099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.758755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.759031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.759301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.760012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:15.760304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.761722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.763898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.765384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.773739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 280/571] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:15.774521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.783218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f426ff32-6d9e-4866-bbf9-ae1773868184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:15.784397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 292/572] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:15.785744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.786020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.786285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.802890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:15.804099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:15.868556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 293/573] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:15.869490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.883969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cb977-f908-40df-a33a-17ff2dc87229 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.917610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:15.918408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:15.918682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:15.918927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:15.928740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:15.930214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:15.947006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:15.948200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 281/574] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:15.948982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:15.964648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11ebd9-388f-4680-b233-63242b429c60 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:15.999474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.000266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.000538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.000793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] PATH_INFO: `/v3/users/glance` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.008169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.009659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.023740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 04 05:57:16.024947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 294/575] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:16.025716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.053841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0797b7d-7836-47d2-b921-dbe1704ba95c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.090113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.090911 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.091195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.091473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.098385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.099815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.112944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:16.114117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 282/576] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:16.114880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.131420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d7640-b2af-4e37-8456-cf4113c0e40c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.162955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.163622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.163891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.164176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.164924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.165235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.166609 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.178263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 295/577] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.179027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.210667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0c01-034c-4c6c-835b-0568b9df663c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.244780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.245602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.245874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.246142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.256217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:16.263138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:16.264525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 283/578] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:16.265090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.273448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f0daf-6805-4317-b725-074226b2b440 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.306069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.306711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.307011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.307276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.307987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.308289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.309692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.320537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 296/579] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.321344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.361745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15649afb-e491-4b52-9783-d877bb261d68 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.393408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.394118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.394396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.394749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.395583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.395880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.397696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.414537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 284/580] 10.222.0.30 () {56 vars in 1137 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.415952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cbbb8-06a3-442d-9ecf-4bd093cad624 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.416131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.448540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.449221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.449491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.449756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.450526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.450825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.452250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.463851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 297/581] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.464611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.514565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ecef3-1655-48a9-9b46-a64c47546f45 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.550640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.551395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.551669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.551935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.555663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd0aa4-ced1-4de6-9e8b-ca574c0d6b7f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.558670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.560101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.573159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:16.574320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 285/582] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:16.575070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.589108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.589768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.590044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.590316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.591014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.591307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.592654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.600730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 298/583] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.601533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.676486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02b62d-fdae-43ee-9922-387a64a9fe39 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.696447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a4a9-f77a-4907-a142-4bab76ae5389 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.709618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.710407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.710684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.710954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.718433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.719882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.729205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.729989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.730262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.730524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.733177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 04 05:57:16.734374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 286/584] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:16.735127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.741726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.743160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.761395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:16.762588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 299/585] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:16.763353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.832204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d04a18-6ccb-4857-9924-a0b45a0756e8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.859698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0d3c4-e69b-409b-82ac-c99279467600 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:16.864874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.865566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.865843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.866116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.866946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=a9357bd3de9b4dbebed74a1dcd6420c4) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.867257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.868700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.873944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 287/586] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/role_assignments?user.id=a9357bd3de9b4dbebed74a1dcd6420c4&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.874707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.894371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:16.894824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:16.895101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:16.895370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:16.896169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:16.896466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:16.898334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:16.911351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 300/587] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:16.917180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:16.985142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2985e69-d9f9-4571-9942-0b6ca586ac80 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.020959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.022158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.022438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.022711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.023947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a5a9-68f9-45aa-9694-f43ffc494ba1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.034379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.035961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.053577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:17.054962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 288/588] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:17.056073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.065646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.066631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.067088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.067360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.068209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:17.068515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.069997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.088994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 301/589] 10.222.0.30 () {56 vars in 1137 bytes} [Mon Apr 4 05:57:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:17.089804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.158465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21fc4-d451-4981-969c-892136ee4a08 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.183564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e6745-ef15-4f99-9def-36da6e63d225 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.191585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.192535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.192990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.193418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.194301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:17.194768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.196172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.208749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 289/590] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:17.209864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.217551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.218462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.218740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.219019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/07287811d9ef4e04bd62a665d642b61d/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.233875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=07287811d9ef4e04bd62a665d642b61d, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.235395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.249623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 302/591] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:17 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/07287811d9ef4e04bd62a665d642b61d/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:17.250809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.315168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ed1e1-007f-4309-b9e5-32398915b4bd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.352789 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.353555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.353836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.354110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.354877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:17.355630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.356652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.369340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700a32-6cbc-45fe-aa4c-ea2562a29438 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.369944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 290/592] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:17.370610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.408062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.409365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.410007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.410491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.422337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.424258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.443626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:17.445294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 303/593] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:17.446340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.485703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbafce-2b4f-43d2-800c-cef36e2df501 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.529525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.531096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.531876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.532625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.542209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.544631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.552292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391d2e-db19-40f2-a612-21034c932679 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.562867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:17.569566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 291/594] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:17.569566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.589829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.590661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.590935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.591197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.599112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.600550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.613928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 04 05:57:17.615394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 304/595] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:17.616163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.692572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8d2b-10b8-4007-8712-0f38dec62d72 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.732083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2391-fe63-439c-93bb-50fd932eec80 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.736708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.737354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.737661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.738016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.738748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:17.739055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.740875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.757114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 292/596] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:17.758376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.773531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.774209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.774644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.774923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.776098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:17.776668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.778353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.795787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 305/597] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:17.796747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.863794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b07b-0630-4c7e-b763-14798de99dd3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.904788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.905757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.906044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.906320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.907306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:17.907626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.909706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.911416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb5a0-acf3-456a-8afa-537846fffdda None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:17.928536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 293/598] 10.222.0.30 () {56 vars in 1139 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:17.929704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:17.953499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:17.954323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:17.954598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:17.954882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:17.963910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:17.966157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:17.982003 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:17.984976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 306/599] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:17.985969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.052932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e888f-1d37-4823-867e-e824051e14e5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.088333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e689f8-8ca5-41c4-8f85-8ddf31ef6264 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.095542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.096866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.097428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.097729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/1e1cdcbf35ed49a1b130757f7230e5a7/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.116678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=1e1cdcbf35ed49a1b130757f7230e5a7, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.118677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.123102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.124199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.124593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.124966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.139343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.140473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 294/600] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:17 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/1e1cdcbf35ed49a1b130757f7230e5a7/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:18.141378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.141507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.167337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:18.169073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 307/601] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:18.180453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.256929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df4dc-d3e0-4e93-bc4c-d96cbc12f851 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.311922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.312617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.312920 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.313202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.314495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:18.314810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.320969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.346070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973eac8-bfd7-4894-83ea-a04fd99b0c2e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.359478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 295/602] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:18.371415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.393010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.394748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.395211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.395654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.396944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:18.397871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.399759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.416474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 308/603] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:18.424139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.482892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362677c4-5315-442f-a750-7607dfac88e8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.544133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4622f-f986-44dc-95e8-dbf19782b137 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.574284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8650502-6532-426e-a598-804afbc14180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.575213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8650502-6532-426e-a598-804afbc14180 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.575645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8650502-6532-426e-a598-804afbc14180 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.575921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8650502-6532-426e-a598-804afbc14180 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/7f0640518ddc4893b20b6d79c80c21ed/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.581753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.582803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.583443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.583889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.593161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.595221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.611138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:18.612381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8650502-6532-426e-a598-804afbc14180 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=7f0640518ddc4893b20b6d79c80c21ed, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.613294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 309/604] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:18.617181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8650502-6532-426e-a598-804afbc14180 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.619957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.645026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 296/605] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:18 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/7f0640518ddc4893b20b6d79c80c21ed/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:18.728994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59fe9-cab8-43e4-b2e3-763a3c841017 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.767862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.768975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.769498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.769969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.771046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:18.771977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:18.773742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae86e-9a1d-424a-81ee-f05d3eaf503c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:18.787654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 310/606] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:18.793725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8650502-6532-426e-a598-804afbc14180 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:18.933024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8650502-6532-426e-a598-804afbc14180 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:18.980272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c9f60-57b4-4e30-b13e-2a387c726a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:18.981716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c9f60-57b4-4e30-b13e-2a387c726a3d None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:18.982212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c9f60-57b4-4e30-b13e-2a387c726a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:18.982684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c9f60-57b4-4e30-b13e-2a387c726a3d None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/6ada2f7acb1349e38b96dfbda5546101/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:18.999332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c9f60-57b4-4e30-b13e-2a387c726a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=6ada2f7acb1349e38b96dfbda5546101, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:19.001187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c9f60-57b4-4e30-b13e-2a387c726a3d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:19.019995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 297/607] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:18 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/6ada2f7acb1349e38b96dfbda5546101/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:19.426146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cf9bc-338b-481c-bc15-eb0be0f0ff9e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:19.427399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cf9bc-338b-481c-bc15-eb0be0f0ff9e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:19.427914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cf9bc-338b-481c-bc15-eb0be0f0ff9e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:19.430396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 311/608] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:19.437115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:19.438062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:19.438553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:19.456390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:19.458126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:19.544378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 298/609] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:19.577835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cf9bc-338b-481c-bc15-eb0be0f0ff9e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:19.722011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cf9bc-338b-481c-bc15-eb0be0f0ff9e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:19.765148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:19.765950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:19.766223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:19.766558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:19.786030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:19.792983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:19.794505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 312/610] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:19.800650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:19.935714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de86c22-5e15-41d7-80c0-0741c6c569d5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:19.970554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:19.971589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:19.972348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:19.973054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:19.974025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:19.974523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:19.976112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:19.989227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 299/611] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:19.993990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.143798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360b5a-a7b0-4a53-b9ab-1d395880dae0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:20.192517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:20.193351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.193631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.193889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.204729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:20.206191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:20.227608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-aad6c447-e75d-430a-892b-c1bb439b7225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:20.229073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 313/612] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:20.234677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.254792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55093c-42a9-4b5c-8b82-f8cdc3dd358f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.255116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55093c-42a9-4b5c-8b82-f8cdc3dd358f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.255338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55093c-42a9-4b5c-8b82-f8cdc3dd358f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.257407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 314/613] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:20.264933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.264933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.264933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.292385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:20.293619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:20.410114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460840be-204d-41c2-b782-3d7ceadc6672 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:20.415737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 315/614] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:20.458844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:20.459524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.459782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.460051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.460832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:20.461157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:20.462529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:20.479006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 300/615] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:20.484466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.498747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.623793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2500d-4c01-4f32-9bcf-9e0c73f4c049 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:20.658160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:20.658964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.659237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.659642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.670022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:20.674381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa287-14e8-4135-86c2-0e47a13687c5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:20.676996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:20.678530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 301/616] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:20.694118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.724988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:20.725794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.726077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.726351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.733922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:20.735323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:20.749996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f99df913-9f8a-47f9-bdf9-52752baf075f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 04 05:57:20.751564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 316/617] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:20.752867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8f37-fc2f-446e-99fc-47f60452b454 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.753232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8f37-fc2f-446e-99fc-47f60452b454 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.753514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8f37-fc2f-446e-99fc-47f60452b454 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.759499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 317/618] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:20.760180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8f37-fc2f-446e-99fc-47f60452b454 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.796269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b5b1f-feed-4972-b3c8-08087774d21d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:20.831281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:20.832061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.832335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.832604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.833383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:20.833685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:20.835058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc7016-cc5d-440a-9a82-cdf548ad1e8b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:20.847847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 302/619] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:20.849282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.849565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.849840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.866218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8f37-fc2f-446e-99fc-47f60452b454 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:20.866484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:20.867578 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:20.901030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:20.901708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:20.902040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:20.902313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:20.903201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:20.903505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:20.905070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:20.923233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 318/620] 10.222.0.30 () {56 vars in 1135 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:20.924240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:20.933542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 303/621] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:20.934384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.031168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cd0a5-9b2b-4f18-952d-5c1206a85cf3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.046969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449f67-ba25-45c2-8118-4a10c75687b5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.065275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.066295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.066570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.066838 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.077092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.078748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.080834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.081741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.082023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.082297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.092718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.094254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.096520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:21.098363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 304/622] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:21.099162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.111939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:21.113731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 319/623] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:21.114530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.205138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffc75-1b53-40d3-97c7-4691df0fffaa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.218545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670931b-d818-4310-bb77-d56e1fc58581 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.239214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.240018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.240295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.240564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.251067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:21.252188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.252853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.253212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.253620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.254430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:21.254783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.256209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.258321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:21.259877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 305/624] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:21.260600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.275063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 320/625] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:21.275999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.359235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12ec72-09cb-4e61-ae9c-fad2d2d8f85a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.375494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5889f1-3428-4e3f-9753-1ae702587fb6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.392673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.393377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.393653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.394018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.394757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:21.395161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.396929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.409826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.410738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.411021 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.411296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.412044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:21.412346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.413959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.414134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 306/626] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:21.414895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.422536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 321/627] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:21.428442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.516314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714cf0d-65fa-4445-86bb-cbb2c1f8d607 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.533016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2e7f2-e7b3-439a-a2b3-9212fafa8f6b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.552111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.552966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.553246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.553515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.560950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.562373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.566823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.567624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.567914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.568194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.575251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.575446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:21.581282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 307/628] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:21.581545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.581712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.594674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-636ca0bb-6b1f-46ef-a892-e001e6f7d253 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:57:21.596018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 322/629] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:21.597397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4b57-7e27-4548-9976-d7a12fc8462d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.599362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4b57-7e27-4548-9976-d7a12fc8462d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.599362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4b57-7e27-4548-9976-d7a12fc8462d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.599838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 323/630] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:21.600556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4b57-7e27-4548-9976-d7a12fc8462d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.678274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a81f3-f47e-4549-8d85-0880a1e5b210 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.700142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4b57-7e27-4548-9976-d7a12fc8462d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.715280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.716242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.716448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.716725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.727605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.729103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.733242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.733909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.734183 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.734458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.735248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:21.735554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.736997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e770e-e374-4dd1-bd97-1672588f82f3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.745723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:21.751512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 308/631] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:21.751512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.753268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 324/632] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:21.754775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.755069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.755348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.771948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:21.773167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:21.843081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 325/633] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:21.843937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.871767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37023-d803-4c53-94f2-e46b9a1322af None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.904156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.904821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.905125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.905392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.906217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:21.906519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.907950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.929132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 309/634] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:21.929132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:21.941423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eec3ba-db2e-47e7-b989-5f21a8598cf1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:21.973010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:21.973657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.973933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.974203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.974913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:21.975210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:21.976570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57101733-3c39-485f-84ee-31fb9a2b7bf4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:21.987233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 326/635] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:21.988727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5037-8442-4a1f-88dd-6f1e8b64e7c7 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:21.989036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5037-8442-4a1f-88dd-6f1e8b64e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:21.989309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5037-8442-4a1f-88dd-6f1e8b64e7c7 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:21.992342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 327/636] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:21.992342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5037-8442-4a1f-88dd-6f1e8b64e7c7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.024161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad33daa-5126-46f9-9e9e-35c2138f5f21 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.057852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.058744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.059017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.059284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/a9357bd3de9b4dbebed74a1dcd6420c4/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.074432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=a9357bd3de9b4dbebed74a1dcd6420c4, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.075964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.086234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5037-8442-4a1f-88dd-6f1e8b64e7c7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.089628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 310/637] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:21 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/a9357bd3de9b4dbebed74a1dcd6420c4/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:22.090426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.121954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.122791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.123054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.123317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.135112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:22.142194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:22.143477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 328/638] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:22.144605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.206473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0236-7ad2-469d-8ff5-2f641a762196 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.243341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.244181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.244827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.245148 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.253205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e26fe-3c90-4387-a759-0babf6a7d398 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.292009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.292811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.293205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.293474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] PATH_INFO: `/v3/users/glance` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.301121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.302590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.316334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-974781e1-9360-418a-82a3-97a8658ecfaa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 04 05:57:22.317897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 329/639] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:22.319142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.319428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.319697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.327157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.328610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.336223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:22.337427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:22.405532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 330/640] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:22.406739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.443498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 311/641] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:22.445147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.504983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b01399-2452-4988-9da0-37b455e96e25 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.537749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.538469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.538863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.539210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.540029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:22.540397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.541882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.543276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1ef6-3e12-4b9b-9625-11d0a52f7ba0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.554576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 331/642] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:22.554576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.577853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.578534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.578814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.579094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.579916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:22.580225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.581987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.599081 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 312/643] 10.222.0.30 () {56 vars in 1137 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:22.600172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.646159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007d795-94f3-4217-8a03-66d5e3ffcd18 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.679175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.679957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.680237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.680514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.690536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:22.697688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:22.698874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 332/644] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:22.701695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.701808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20d85c-1c6d-46e7-9330-c8b11aa01000 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.737208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.738080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.738334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.738625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.748941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.750439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.767246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:22.773219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 313/645] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:22.774232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.800580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399717ca-ac0b-4e98-b2b5-d11006475cbd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.835702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.836496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.836780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.837077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.847503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.848993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.865284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:22.870821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 333/646] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:22.870821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:22.886213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b9c9b-6d08-48f5-9885-14dd28022f40 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.919753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.920770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.921280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.921750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.961943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072703-4f36-4597-9caa-361e75b40575 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:22.988227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.989703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:22.995417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dbe50-7685-4814-8060-d002175f306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:22.996086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dbe50-7685-4814-8060-d002175f306e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:22.996362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dbe50-7685-4814-8060-d002175f306e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:22.996630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dbe50-7685-4814-8060-d002175f306e None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:22.997406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dbe50-7685-4814-8060-d002175f306e None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:22.997708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dbe50-7685-4814-8060-d002175f306e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:22.999055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dbe50-7685-4814-8060-d002175f306e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.012200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 334/647] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.012200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dbe50-7685-4814-8060-d002175f306e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.090163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 314/648] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:23.091630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.104514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dbe50-7685-4814-8060-d002175f306e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.136667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.137359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.137635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.137903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.138620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:23.138922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.140285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.152276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 335/649] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.152933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.195632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b2b6-9414-4427-ad7c-ca2157903ee1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.230948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.231601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.231876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.232158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.232873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:23.233212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.234575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.250139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 315/650] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.250139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.254583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2c7e1-1274-4cb8-a4f5-eefe1487e7f3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.288232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.289066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.289348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.289619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.299640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.301244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.317980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:23.319168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 336/651] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:23.319928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.349913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e77c5-5905-4b0d-b300-4a5b1588ee47 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.382079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.382887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.383156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.383426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.393832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.395388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.412260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:23.413483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 316/652] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:23.414255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.414605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8d1d-cf8b-47be-a01e-32077eee78b8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.448172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.449265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.449679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.450087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.456883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.458541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.472145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:23.477951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 337/653] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:23.477951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.511069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd80a-8a5a-4220-9732-5ab2058dc0bc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.550722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.551522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.551803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.552082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.559738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.561199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.574698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 04 05:57:23.575877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 317/654] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:23.576636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.585810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691de02-484d-4706-a3f6-e2a313b278a2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.621225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.621834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.622099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.622368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.623091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:23.623392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.624776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.636632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 338/655] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.637487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.687572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01120050-f06c-4ceb-9a42-5dd9799d125f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.720577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.721591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.721953 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.722237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.722967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:23.723270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.724772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.734275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a6533-723b-4c8a-8685-23f55530af18 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.737771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 318/656] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.738863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.768074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.768767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.769080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.769352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.770139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:23.770444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.772293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.785043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 339/657] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.785230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.847763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61563-a69f-47ca-9253-63c2dd024bc3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.884688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.885322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.885603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.885882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.886715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:23.887021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.888454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.890667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9f823-50c5-4fc0-b245-84cc8519e780 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:23.918124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 319/658] 10.222.0.30 () {56 vars in 1137 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:23.918124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:23.931217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:23.932031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:23.932307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:23.932573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:23.940005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:23.942074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:23.955968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 04 05:57:23.961906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 340/659] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:23.961906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.018245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc487e3a-495a-4a02-9502-f97148d8ac92 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.054947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.055756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.056041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.056317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.061892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4524ff-2921-4ef6-95f5-d80f3ce93741 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.063137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.064795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.077547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:24.083637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 320/660] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:24.083637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.101289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.101934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.102208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.102474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.103291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=07287811d9ef4e04bd62a665d642b61d) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:24.103592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.105036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.121224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 341/661] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:23 2022] GET /identity/v3/role_assignments?user.id=07287811d9ef4e04bd62a665d642b61d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:24.121224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.187476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762272a-ef19-44c2-96b2-f207d5c3c001 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.228057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.228726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.229037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.229313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.229936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc152-726f-4419-849f-7cd388273633 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.267008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.267850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.268216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.268678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.269915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:24.270320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.272333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.291783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 342/662] 10.222.0.30 () {56 vars in 1139 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:24.297490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.304612 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.306182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.406183 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ac60a-1994-4c7f-8c13-2862b0483f44 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.412262 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 321/663] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:24.416753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.443497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.444088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.444368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.444643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.445462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:24.445782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.447223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeea3a-07c3-43f2-8cef-72153c7d3b93 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.459111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 343/664] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:24.460478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05b26-9a0a-4b14-b432-e8a60b76ba27 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.460764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05b26-9a0a-4b14-b432-e8a60b76ba27 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.465133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05b26-9a0a-4b14-b432-e8a60b76ba27 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.467220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 344/665] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:24.468178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05b26-9a0a-4b14-b432-e8a60b76ba27 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.521833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9111567-e82c-4023-aa48-4e426f04fc62 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.557238 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad97b4-701d-46c1-b0cf-f521a1642cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.558096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad97b4-701d-46c1-b0cf-f521a1642cbc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.558379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad97b4-701d-46c1-b0cf-f521a1642cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.558653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad97b4-701d-46c1-b0cf-f521a1642cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.566917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05b26-9a0a-4b14-b432-e8a60b76ba27 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.599493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.600285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.600560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.600822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.610943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.612498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.624170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad97b4-701d-46c1-b0cf-f521a1642cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.625659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad97b4-701d-46c1-b0cf-f521a1642cbc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.629285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:24.634934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 345/666] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:24.634934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.727613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683556b-2dba-4c45-91fb-44b1ab3a44a5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.729976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 322/667] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:24.731341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.731626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.731900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.748824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:24.750004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:24.762561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.763218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.763476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.763750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.764578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=1e1cdcbf35ed49a1b130757f7230e5a7) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:24.764874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.766352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.772648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 346/668] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/role_assignments?user.id=1e1cdcbf35ed49a1b130757f7230e5a7&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:24.773606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.833315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 323/669] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:24.834662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.877660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341b4f-7b4f-4941-9bda-9c2513aaf3cf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:24.914054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:24.914730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:24.915006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:24.915273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:24.915999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:24.916297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:24.917714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:24.930903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 347/670] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:24.931793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:24.966031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e003917-e92d-4dad-bea8-9605fd7e73d1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.004593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.005360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.005633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.005900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.016346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.017842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.036930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:25.038213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 324/671] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:25.038944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.046230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665afb-e1e2-490a-afe4-01f11c9b5ac4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.087548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.088518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.088871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.089334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.100876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:25.108192 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:25.109891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 348/672] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:25.110894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.158004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f3ede-6a04-4641-b117-9665eccc26a7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.193889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80352edc-a616-4042-a067-307c80d823bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.194934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80352edc-a616-4042-a067-307c80d823bb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.195371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80352edc-a616-4042-a067-307c80d823bb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.195796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80352edc-a616-4042-a067-307c80d823bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.202892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80352edc-a616-4042-a067-307c80d823bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.204499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80352edc-a616-4042-a067-307c80d823bb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.216136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff3da-ecba-4353-85c6-bef5dbd0c11f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.218606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-80352edc-a616-4042-a067-307c80d823bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:25.220348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 325/673] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:25.221354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80352edc-a616-4042-a067-307c80d823bb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.249742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.250408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.250685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.250952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.251668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:25.251964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.253538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.266031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 349/674] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:25.266863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.328352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80352edc-a616-4042-a067-307c80d823bb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.363714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.363934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381c7c-25db-4a43-b800-6e6f1906fa8d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.364784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.365252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.365663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.366560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:25.367001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.368571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.378202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 326/675] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:25.379852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.399648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.400310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.400584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.400849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.401677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:25.402035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.403391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.415607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 350/676] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:25.416335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.489296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe02023-97de-4adf-a949-6f49bd68db07 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.511758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55832bb6-91cd-41ac-a0f4-fdba05951915 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.523993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.525012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.525458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.525870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.532877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.534531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.545116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.545911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.546188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.546455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.549258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:25.551181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 327/677] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:25.552234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.557128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.558569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.576893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:25.579173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 351/678] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:25.581735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.658043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84288d32-00cc-4f38-8041-f76f376ff7a0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.677980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e89134-05e9-4be4-b6c9-d534b4fcb4b5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.693751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.694720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.695225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.695688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.696770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=7f0640518ddc4893b20b6d79c80c21ed) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:25.697326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.699015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.705757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 328/679] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/role_assignments?user.id=7f0640518ddc4893b20b6d79c80c21ed&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:25.706940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.710646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.711996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.711996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.711996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.712638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:25.712968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.714453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.727964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 352/680] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:25.733386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.847728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb919079-b9c2-482c-83ef-18925babc715 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:25.889219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:25.890311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:25.890805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:25.891269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:25.892272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:25.892813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:25.894503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:25.907804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 329/681] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:25.913512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:25.972543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfd84-b17b-43cc-b207-3af88e582897 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:26.011160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:26.011510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.011787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.012054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.012867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=6ada2f7acb1349e38b96dfbda5546101) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:26.014031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:26.015469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:26.022095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 353/682] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/role_assignments?user.id=6ada2f7acb1349e38b96dfbda5546101&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:26.031949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828958-3ed3-41b1-a5cf-73d25539045c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:26.075996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:26.076929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.077272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.077605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.086658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:26.088261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:26.103850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 04 05:57:26.105500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 330/683] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:26.111193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:26.222531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd235a-f2b9-4041-882a-9e3614974735 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:26.258828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:26.259598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.259942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.260277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.261237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:26.261642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:26.263171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:26.285839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 354/684] 10.222.0.30 () {56 vars in 1135 bytes} [Mon Apr 4 05:57:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:26.291444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:26.407776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0828d6-ccbd-4365-9123-9510826d37bb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:26.443218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3f394-baac-4ceb-ab32-abdd4cc2ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:26.444032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3f394-baac-4ceb-ab32-abdd4cc2ed8c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.444397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3f394-baac-4ceb-ab32-abdd4cc2ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.444762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3f394-baac-4ceb-ab32-abdd4cc2ed8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.524584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3f394-baac-4ceb-ab32-abdd4cc2ed8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:26.526239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3f394-baac-4ceb-ab32-abdd4cc2ed8c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:26.641336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 331/685] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:26.647071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:26.736038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e07d0-e466-407f-b50d-2376d5f00b98 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.736535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e07d0-e466-407f-b50d-2376d5f00b98 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.736535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e07d0-e466-407f-b50d-2376d5f00b98 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.738419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 332/686] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:26.743512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.743795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.744067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.764012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:26.766207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:26.808625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5cd29-e052-4b08-a4ae-e45b96aabbfa None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:26.870522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 333/687] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:26.872159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:26.872991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:26.873268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:26.873535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:26.884386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:26.885871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:26.903616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:26.905885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:26.908827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 355/688] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:26.914478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.077628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f34e1-d1e9-4b5b-87c5-e92d20f0d561 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.095684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6eb40-6960-4f65-82b0-b255cc542e43 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.118696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.119743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.120892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.121465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.143649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:27.153987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:57:27.161572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.162523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.162935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.163337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.163519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 334/689] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:27.164522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:27.165559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.166007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:27.167967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:27.191189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 356/690] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:27.196495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.341588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d26f1-f28d-476e-9101-8fe3acce9749 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.363099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4c62-913c-40fd-ac85-a2c433477cf5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.379944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.381346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.381761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.382166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.389892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:27.391592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:27.407785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:27.409954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 357/691] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:27.419890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.458676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.459391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.459649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.459926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.460686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:27.461014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:27.462407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:27.484154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 335/692] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:27.489739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.531537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938810-a6de-4c1b-b450-fbc1882c64ea None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.572241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.573224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.573696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.574097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.575048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:27.575479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:27.577060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb32e3-49f1-48f0-ba72-0c190b30f522 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:27.598292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 358/693] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:27.599853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca4428-d69d-4ed6-902b-74b8d0777ef5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.600266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca4428-d69d-4ed6-902b-74b8d0777ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.600713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca4428-d69d-4ed6-902b-74b8d0777ef5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.602705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 359/694] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:27.603546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca4428-d69d-4ed6-902b-74b8d0777ef5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.633102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830cd9c-b03f-4f10-b9ef-0c1c34de7faa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.667482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.668594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.669144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.669430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.682746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:27.684579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:27.706073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-25b9c022-c08e-4161-a01d-7eb7cbe5ed4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:27.707628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 336/695] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:27.708883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.709216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.709490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.713088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca4428-d69d-4ed6-902b-74b8d0777ef5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:27.728967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:27.730429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:27.747903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:27.748672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:27.749049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:27.749396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:27.750285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=a9357bd3de9b4dbebed74a1dcd6420c4) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:27.750661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:27.752176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:27.765324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 360/696] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/role_assignments?user.id=a9357bd3de9b4dbebed74a1dcd6420c4&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:27.766366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.811988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 337/697] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:27.859530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:27.950454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e71a-75ba-4252-ac0a-ec7c67f533d0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.021134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.022550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.023027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.023483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.024408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:28.026455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.028055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.044845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 361/698] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:28.050130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.057912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccc07e-2f2f-4162-9c21-a845c2e3c2ef None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.101980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.102841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.103119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.103394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.116978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.118673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.141896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:28.144166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 338/699] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:28.149872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.175927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067986d1-991b-4a19-b448-a7e9924a2b38 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.216497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.217719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.218271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.218733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.227543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.229430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.244443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:57:28.246558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 362/700] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:57:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:28.252216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.264819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a400c3c-66cd-4b7e-99f2-9ac86aab1457 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.301637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.302303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.302575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.302840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.303555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:28.303850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.305316 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.317349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 339/701] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:28.322420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.375013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bdcb-4043-445e-b051-93bb3705b09d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.417784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.418974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.419449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.420081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.421189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:28.421688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.423323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.444061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 363/702] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:57:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:28.450036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.516133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47b3a9-61a2-4c32-8a71-ccccfbc497f3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.562505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb1c92-488b-4c01-90c5-a4433f36e792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.563192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb1c92-488b-4c01-90c5-a4433f36e792 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.563469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb1c92-488b-4c01-90c5-a4433f36e792 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.563740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb1c92-488b-4c01-90c5-a4433f36e792 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.564450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb1c92-488b-4c01-90c5-a4433f36e792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.566176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb1c92-488b-4c01-90c5-a4433f36e792 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.600480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc7b5c-4be5-4240-900d-050372872d99 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.607823 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 340/703] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:57:28 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:28.636996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d800e-63da-470e-b38f-149d2a834768 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.637280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d800e-63da-470e-b38f-149d2a834768 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.637476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d800e-63da-470e-b38f-149d2a834768 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.637759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:28.638570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.639001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.639484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.639589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 341/704] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:28.645700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:28.645980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:28.646616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:28.686128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:28.687361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:28.713747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:28.715237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:28.813529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 342/705] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:28.824229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 364/706] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:28.829647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.838456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:28.960243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38ac76-4661-4638-9d7b-2f8e66c1e762 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:28.971383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee635dc3-b5d0-464c-ba34-3f007010b0ba None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.005400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.006766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.007220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.007662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.009905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.010864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.011148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.011489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.012221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.013719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.020372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.022531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.027770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-ccdc8834-f4a2-4f93-9206-eb8d34fdc4a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 04 05:57:29.033146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 365/707] 10.222.0.30 () {56 vars in 1129 bytes} [Mon Apr 4 05:57:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:29.033146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578e0b1-4e68-41d6-9fff-809fb90c22a9 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.033146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578e0b1-4e68-41d6-9fff-809fb90c22a9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.033146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578e0b1-4e68-41d6-9fff-809fb90c22a9 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.033146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 366/708] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:29.036233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578e0b1-4e68-41d6-9fff-809fb90c22a9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.047503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-2224afab-406b-4d4a-aa2e-42b551251a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:29.052926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 343/709] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:29.052926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.052926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.052926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.071279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:29.072533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:29.140389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 344/710] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:29.141463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.150622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578e0b1-4e68-41d6-9fff-809fb90c22a9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.185024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.185697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.185980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.186253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.187028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.187335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.188798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.193754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 367/711] 10.222.0.30 () {56 vars in 1124 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:29.194549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.244218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ef220-82c4-481a-98cf-92fe6846db2d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.282071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.283122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.283618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.284133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.285231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.285820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.287448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.303988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 345/712] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:29.305443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.308581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d25045-2ef5-4f66-bbbb-26d4b9d7156c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.342770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.343574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.343856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.344137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] PATH_INFO: `/v3/services/network` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.344804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.346206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.357327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 04 05:57:29.358819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 368/713] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:29.359596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.411501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68699-e596-48e6-9ffd-30e095cc3432 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.447428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.448484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.449038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.449511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.450423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.450939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.452519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.458914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 346/714] 10.222.0.30 () {56 vars in 1124 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:29.459657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20587d86-ed1d-42a3-b17d-604c3796fb4f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.460241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.495309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.496049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.496331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.496605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.504377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.505873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.520107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:29.521759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 369/715] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:29.527579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.571678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d822-1021-4eae-acc9-9ccc74b86ee6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.608705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.609722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.610174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.610590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.611460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] RBAC: Adding query filter params (name=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.612003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.613819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.619227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 347/716] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:29.626382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.636956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dee9b-dfd2-4e1e-b1a6-a872a565417a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.669466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.670026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.670350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.670574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.671476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.671678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.680964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.686048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 370/717] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:29.698100 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:29.820949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f446f-bb1d-4d9a-8099-3b75a7adaef9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.822327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3711fd-7a57-49ff-a1cd-4705d0cfa965 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:29.856826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.857773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.858309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.858825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.859909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=07287811d9ef4e04bd62a665d642b61d) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.860524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.861131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:29.861870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:29.862346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:29.862632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:29.863285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282bdd-140a-4a3f-97f5-ab05cf544b73 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.863543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:29.863927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:29.865407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514445e2-8cdd-427b-99e7-f4f4943780c3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:29.870159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 371/718] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/role_assignments?user.id=07287811d9ef4e04bd62a665d642b61d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:29.872948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 348/719] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:30.773247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67e0c-5dc8-4b72-8513-4e8af0de44df None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:30.774274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67e0c-5dc8-4b72-8513-4e8af0de44df None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:30.774760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67e0c-5dc8-4b72-8513-4e8af0de44df None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:30.777038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 372/720] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:30.782049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:30.782574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:30.783073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:30.805949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:30.807162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:30.903119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 349/721] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:30.941437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67e0c-5dc8-4b72-8513-4e8af0de44df None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:31.065866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67e0c-5dc8-4b72-8513-4e8af0de44df None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:31.112474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5c187-25f2-48c5-b073-3642cf8d3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:31.116922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5c187-25f2-48c5-b073-3642cf8d3cde None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.116922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5c187-25f2-48c5-b073-3642cf8d3cde None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.116922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5c187-25f2-48c5-b073-3642cf8d3cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.135292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5c187-25f2-48c5-b073-3642cf8d3cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:31.142226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-51f5c187-25f2-48c5-b073-3642cf8d3cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:57:31.143853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 373/722] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:31.149841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:31.276692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0906f-3402-4c90-b806-5ae8a6942b30 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:31.301643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2e21f-2a4b-42f0-aaab-42f7dc176a73 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.302254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2e21f-2a4b-42f0-aaab-42f7dc176a73 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.302740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2e21f-2a4b-42f0-aaab-42f7dc176a73 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.311930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 374/723] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:31.316641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.317190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.317658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.324985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:31.324985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.324985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.324985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.325416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:31.325416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:31.325416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:31.336406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 350/724] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:31.342618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:31.373951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:31.375409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:31.455148 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbd52f-3645-40f3-b617-b88d04ecd364 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:31.517202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 375/725] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 04 05:57:31.537224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:31.538208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:31.539035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.539309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.539579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.560619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:31.563162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:31.589841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:31.602729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 351/726] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:31.608117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:31.715681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5e1fb-9c2a-4dd7-a067-4f2dcb574115 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:31.780031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:31.781771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.782953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.784809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.790698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d10c6-81a9-44c1-b4c9-a6fc093fc7eb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:31.815495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:31.828460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:31.833954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 376/727] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:31.858228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:31.897697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:31.898400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:31.898679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:31.898950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:31.899684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:31.899989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:31.909831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:31.949958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 352/728] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:31.971970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:32.012224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102fc7d-616b-4bb6-91cd-ee0b844b4c5e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.053573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.054263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.054545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.054818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.055579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:32.055883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.057308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.075587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 377/729] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:32.081752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:32.320931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319394d-fb71-4141-88ae-e1839da38940 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.392474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.393406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.396922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.396922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.397094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea54cd-3163-425a-9b96-b403f603f33d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.403748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.405594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.431594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-28751e27-b705-4116-bdb4-23ff685d3c29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 04 05:57:32.433231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 353/730] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:32.435904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c128f8-866c-4af1-b77a-bc5dbcb579c4 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.436261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c128f8-866c-4af1-b77a-bc5dbcb579c4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.437152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c128f8-866c-4af1-b77a-bc5dbcb579c4 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.439058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 354/731] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:32.440320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c128f8-866c-4af1-b77a-bc5dbcb579c4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:32.480144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.481018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.481305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.481776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.497308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.498799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.521696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-abbae290-4b71-4688-b014-92a9d902b8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:32.523579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 378/732] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:32.524846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.525311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.525663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.547087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:32.548309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:32.581871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c128f8-866c-4af1-b77a-bc5dbcb579c4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.625426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 379/733] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:32.626424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:32.628430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.629675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.630026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.631362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.632339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:32.632720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.634328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.660037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 355/734] 10.222.0.30 () {56 vars in 1135 bytes} [Mon Apr 4 05:57:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:32.666548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:32.743307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25037f-ef32-427f-822d-c171a8aa8448 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.779206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc388a6-c041-4c94-93b9-e9d2688f0e40 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.785509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.786302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.786577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.786843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.787617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:32.787919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.789310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.808723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 380/735] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:32.809956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:32.822291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38191b5b-1e7f-421e-a631-06e3eacbf708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.823249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191b5b-1e7f-421e-a631-06e3eacbf708 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.823249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191b5b-1e7f-421e-a631-06e3eacbf708 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.823488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191b5b-1e7f-421e-a631-06e3eacbf708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.898833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191b5b-1e7f-421e-a631-06e3eacbf708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.900309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191b5b-1e7f-421e-a631-06e3eacbf708 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.927340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2520d-b516-40cc-bd68-c26b52a56042 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:32.963212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:32.963876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:32.964151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:32.964422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:32.965163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:32.966531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:32.988938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 381/736] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:57:32 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:32.988938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.008524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 356/737] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 04 05:57:33.010008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d8d6-d45d-43c8-ab97-8e1db471979f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.010292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d8d6-d45d-43c8-ab97-8e1db471979f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.010560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d8d6-d45d-43c8-ab97-8e1db471979f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.012588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 357/738] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:33.013665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d8d6-d45d-43c8-ab97-8e1db471979f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.127068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd335-2513-49ca-b10c-85a5b6f26e85 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.128286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d8d6-d45d-43c8-ab97-8e1db471979f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.163488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.164302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.164558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.164701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.164882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.166081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.166571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.167026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.175197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.176482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.176921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.177944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.192790 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-a8df6b95-e183-4758-be4a-ede26249b50c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 04 05:57:33.194319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 382/739] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:57:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:33.195275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.195485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.195751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.198426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-cca11516-bd2f-4fa0-b1ff-d31d9c7976a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:33.200944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 358/740] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:33.200944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc503035-6d32-4873-8028-bf395c40c3b1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.200944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc503035-6d32-4873-8028-bf395c40c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.200944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc503035-6d32-4873-8028-bf395c40c3b1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.202570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 359/741] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:33.203825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc503035-6d32-4873-8028-bf395c40c3b1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.215667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:33.216884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:33.287560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 383/742] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:33.288641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.320642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc503035-6d32-4873-8028-bf395c40c3b1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.353366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.354033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.354308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.354577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.355409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:33.355715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.357167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408285d-b61c-4635-ab5a-ca0e6b3267b0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.374464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 360/743] 10.222.0.30 () {56 vars in 1149 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:33.380272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.380501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.380735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.386600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efbce-aa72-40bc-b6b8-2301ea059df8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.398310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:33.399481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:33.420581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.421303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.421590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.421864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.422594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:33.422894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.424330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.439689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 384/744] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:33.439689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.467031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 361/745] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 04 05:57:33.467876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.551120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38f17b-6fb6-4f3c-b2af-f41d98263071 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.566922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a93b-dca1-4edd-9f75-53e8f615183a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.582603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.583271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.583550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.583822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.584546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.585964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.598967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 385/746] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:57:33 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:33.599755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.617649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.618648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.619101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.619550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.696595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.698439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.741734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7294-8e49-4d22-a634-384cf3991d4a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.791051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.791732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.791911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.792240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.800760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.802527 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.814770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 362/747] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:57:33.815891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.821220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:33.822570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 386/748] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:33.827130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.916341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152471-3305-43fc-b693-48e2544f28dd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.923888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d53e29-a3e4-496b-85c3-40c71fcfe900 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:33.953123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.953849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.954126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.954393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.958618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:33.959434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:33.959713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:33.959990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:33.965104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:33.970335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:33.971848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:33.972056 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:57:33.978100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 363/749] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:33.978941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:33.989293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:33.990809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 387/750] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:33.991654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.077542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba38ed-4766-4cac-bddf-bced4519b40a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.091802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62348ec-61fb-4fd2-b2c9-36f38454d352 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.110882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.111543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.111818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.112223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.113050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.113355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.114782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.127383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 364/751] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:34.128320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.128587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.129407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.129687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.129966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.130786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.131085 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.132734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.142067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 388/752] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:34.142879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.249323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff265b0c-887f-4c44-9f1b-e9adb1f9a0ba None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.260454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49403125-e807-4f09-b292-3f87c4cf87ab None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.283217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.284032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.284370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.284707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.285516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.285888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.287374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.295500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.296166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.296446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.296716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.297573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=a9357bd3de9b4dbebed74a1dcd6420c4) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.297881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.299114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 365/753] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:34.299410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.300031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.306198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 389/754] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/role_assignments?user.id=a9357bd3de9b4dbebed74a1dcd6420c4&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:34.307054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.403523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f6403-8150-49ee-8734-95de2a271c3e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.418784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87f79-0360-45fa-b2a0-694c02a7a2a8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.438122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.438945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.439215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.439479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.450740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.452313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.455196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.456219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.456752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.457089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.464838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.466434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.469680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:34.476513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 366/755] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:34.477862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.481696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:34.483292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 390/756] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:34.490359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.579803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42803b-81c4-4e81-bc65-4d82e539f27d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.614909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.615630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.615907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.616174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.616918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.617229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.618610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.636115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 367/757] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:34.637595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.700315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e47c3c-c945-41cd-8232-b084c49c316d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.740821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.741540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.741816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.742083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.742874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.743176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.744595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.752425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0ff8-5b86-441a-a8fa-09fef8c43b97 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.772035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 391/758] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:34.776727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.788240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.789308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.789720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.790149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.797970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.800022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.815405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:57:34.817379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 368/759] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:34.843981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:34.898748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562acef-9736-40d0-838f-a1e2a2149ffa None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.932545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.933342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.933616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.933884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.934704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2237e08b136e422aa924acb345f90b9d) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.935009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.936433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:34.949063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 392/760] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/role_assignments?user.id=2237e08b136e422aa924acb345f90b9d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:34.949302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15737fa-2033-4da2-bead-96ddd3d299e7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:34.989127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:34.989817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:34.990088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:34.990358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:34.991210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:34.991510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:34.992990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:35.013959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 369/761] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:57:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:35.019321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:35.165995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c47b8-6669-442e-ad2e-6ac68131d38e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:35.200325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:35.201166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:35.201446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:35.201721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:35.213666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:35.215173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:35.233394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:35.239582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 393/762] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:35.241068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:35.391318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b382b-4be6-4e0c-bd64-489e9893c4fb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:35.436251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:35.436849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:35.437200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:35.437478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:35.438208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:35.438510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:35.439889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:35.456472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 370/763] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:35.457972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:35.575766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576861a8-fbf6-42aa-b465-1f5a3ba430e0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:35.616209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:35.617030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:35.617304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:35.617567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:35.630006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:35.631457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:35.650265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f2562681-8d7b-4992-a503-ce2ee39a05ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:35.651758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 394/764] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:35.657298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:35.836797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2db5f-85b0-4f46-854a-32a2a276b3cd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:35.888093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb413-61ee-46e6-b3d6-22035fe874ec None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:35.888449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb413-61ee-46e6-b3d6-22035fe874ec None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:35.888636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb413-61ee-46e6-b3d6-22035fe874ec None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:35.890446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 395/765] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:35.894523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:35.895186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:35.895460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:35.895728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:35.896880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:35.897207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:35.898634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:35.905441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:35.905911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:35.905984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:35.916092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 371/766] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:35.935655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:35.935847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:35.937200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:36.041357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 396/767] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:36.078045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.088836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39a22-f91b-401e-86ab-08e0d218dc52 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.133643 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4864d-54fa-40a4-a16c-7ba6e3754e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.134541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4864d-54fa-40a4-a16c-7ba6e3754e94 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.134815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4864d-54fa-40a4-a16c-7ba6e3754e94 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.135083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4864d-54fa-40a4-a16c-7ba6e3754e94 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/07287811d9ef4e04bd62a665d642b61d/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.138705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4864d-54fa-40a4-a16c-7ba6e3754e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=07287811d9ef4e04bd62a665d642b61d, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.140161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4864d-54fa-40a4-a16c-7ba6e3754e94 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.168099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 372/768] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:35 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/07287811d9ef4e04bd62a665d642b61d/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 05:57:36.177855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b85a45-e9ab-4efa-b83e-7ae49c1e795b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.178206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b85a45-e9ab-4efa-b83e-7ae49c1e795b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.178445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b85a45-e9ab-4efa-b83e-7ae49c1e795b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.180770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 373/769] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:36.186376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.186745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.187087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.206341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:36.207589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:36.278829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d66f67-6dba-4083-96cc-efab6ffd05ee None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.342031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 374/770] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:36.345478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.346516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.346763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.347040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.347805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.349226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.368942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.387278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 04 05:57:36.388728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 397/771] 10.222.0.30 () {56 vars in 1129 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:36.395416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.504924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7ae2-1db9-4d2d-bf40-85845b08226a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.509664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64edac2-b163-4aff-8c8f-97bd4d32ed26 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.532581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.533404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.533605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.534035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.534709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:36.535012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.536374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.542236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 398/772] 10.222.0.30 () {56 vars in 1124 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:36.548936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.570945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.572130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.572542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.572972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] PATH_INFO: `/v3/services/network` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.573685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.575623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.588733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 04 05:57:36.590471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 375/773] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:36.597951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.729767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fb9d6-8099-4d75-b9ee-e93be777bd42 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.765907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9057cb-917e-4c70-bcb2-18ea4b5d7049 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.795022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.795948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.796229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.796497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.797265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:36.797529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.798951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.811551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 399/774] 10.222.0.30 () {56 vars in 1124 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:36.815088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.815765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.816045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.816317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.817239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] RBAC: Adding query filter params (name=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:36.818152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.819194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.820594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.836662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 376/775] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:36.840010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:36.931599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b4d4-a820-462d-8e6f-6e416e572dcb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:36.967790 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:36.968588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:36.968869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:36.969168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:36.969960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] RBAC: Adding query filter params (interface=public, service_id=bd50e528d343445abbb5b6bc2bfc8dd3, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:36.970281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:36.972273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:36.984924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 400/776] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/endpoints?service_id=bd50e528d343445abbb5b6bc2bfc8dd3&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:36.986644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:37.083008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38106cf4-2dbc-452f-9260-da2a44f6b10a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:37.136118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:37.136797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.137096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.137371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.138082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] RBAC: Adding query filter params (type=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:37.138392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:37.139775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:37.155333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 377/777] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:37.161024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:37.209105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0672-6da8-434f-bba0-8d19b1bf4599 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:37.281303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:37.282026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.282244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.282511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.283213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:37.285542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:37.289874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103750a-954f-4291-8f84-66f064d694cb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:37.299952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 401/778] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:57:36 2022] GET /identity/v3/services => generated 772 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:37.332726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:37.333811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.334339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.334820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.335885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] RBAC: Adding query filter params (interface=public, service_id=e99f25481a4643bab38063e260ba9757, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:37.336432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:37.341365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe508f-e165-4eee-80e9-11f109c098ff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:37.354663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 378/779] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:57:37 2022] GET /identity/v3/endpoints?service_id=e99f25481a4643bab38063e260ba9757&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:37.355791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:37.518382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf117f2-00bd-4f38-a895-4a92b6fb243b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.518686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf117f2-00bd-4f38-a895-4a92b6fb243b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.518968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf117f2-00bd-4f38-a895-4a92b6fb243b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.519264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150f2a-14df-4055-9990-82f00c643130 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:37.520867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 379/780] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:37.527693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.528219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.528746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.550944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:37.553717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:37.564594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3eeb5-f508-402a-935b-31ad512505a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:37.565723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3eeb5-f508-402a-935b-31ad512505a3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.566242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3eeb5-f508-402a-935b-31ad512505a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.566694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3eeb5-f508-402a-935b-31ad512505a3 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.567555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3eeb5-f508-402a-935b-31ad512505a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:37.569165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3eeb5-f508-402a-935b-31ad512505a3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:37.574582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 402/781] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:57:37 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:37.622857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb28f-2c08-4270-a5f4-72da16dab6a8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.623437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb28f-2c08-4270-a5f4-72da16dab6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.623916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb28f-2c08-4270-a5f4-72da16dab6a8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.626604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 403/782] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:37.632162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.632477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.632744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.652238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:37.653984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:37.655593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 380/783] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:37.717147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:37.738963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 404/784] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:37.763883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:37.880243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed721987-8799-4b6e-b6df-2366398e3a79 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:37.897842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7498b5-b9a2-44cc-927d-7f73b9adad58 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:37.922286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:37.923558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.924378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.925319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.932167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:37.933043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:37.933322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:37.933589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:37.937972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:37.944089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:37.946890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:37.948591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 405/785] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:37.952923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:57:37.952923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 381/786] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:37.954725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:37.959378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.065161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c2ae-c514-4137-92a0-1c2362492136 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.074832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6c5fb-efdb-413f-a1a7-48dedd21199a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.112232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.113905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.114673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.115427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.116668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:38.117191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.118774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.128474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 406/787] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:38.134385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.136309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.137063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.137342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.137609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.138361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:38.138661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.140105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.160568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 382/788] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:38.166124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.235285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d9d62-c93d-4072-b6ac-9092950ff6ea None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.269169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.270373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.270838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.271647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.283430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.285302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.302414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:38.304266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 407/789] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:38.309837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.368359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1102b-270c-4ce3-90ba-7c162bb4a1f1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.432960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.434122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.434586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.435041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.449313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.451743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.471151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:38.473204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 383/790] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:38.478832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.491160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26eb5-e5cd-40d0-b0fd-6e7296dde960 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.529547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.530610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.531222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.532174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.533478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:38.534884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.538786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.562404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 408/791] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:38.569167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.671620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbcaec-9c43-49a0-a7c1-016c34cf454d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.732694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.733736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.734824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.735312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.736795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:38.737479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.740624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbb67-d45c-4916-8c7e-977c44d03e93 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.741197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.762709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 384/792] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:38.768485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.807023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.808221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.810015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.810480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.821581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.823473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:38.850437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 04 05:57:38.852834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 409/793] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:38.858353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:38.925959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8fa1c-8d6a-4cbf-b1ff-836a6936c515 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:38.968526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:38.969567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:38.969850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:38.970105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:38.983125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:38.984606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.006842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-1141c79f-ca99-4bf6-8854-e4f9a570a923 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 04 05:57:39.008323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 385/794] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:39.009577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d665-4d7a-46a7-824d-4834edb8ffd5 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.009853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d665-4d7a-46a7-824d-4834edb8ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.010123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d665-4d7a-46a7-824d-4834edb8ffd5 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.015546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 386/795] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:39.016703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.017011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.017287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.021857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d07e-36e8-4097-9c65-3f7b7725db44 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.035204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:39.036394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:39.055558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.056263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.056540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.056809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.057681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:39.057982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.059426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.081420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 410/796] 10.222.0.30 () {56 vars in 1149 bytes} [Mon Apr 4 05:57:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:39.082316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.103268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 387/797] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:39.104137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.190502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfbf3d-5962-4e47-af09-93e3353ebb34 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.226868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93caa-9644-42d9-aebf-ccb52a1b99b2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.232363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.233323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.233804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.234668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.235710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:39.236537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.238990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.260933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.261797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 411/798] 10.222.0.30 () {56 vars in 1135 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:39.262809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.266946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.266946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.266946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.281898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.284239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.310614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:39.313059 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 388/799] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:39.314034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.368972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3d19-4d8b-4348-8ada-525041b3f637 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.411961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.413642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.414068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.414482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.428047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:39.430538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960a479-d7fc-4d2c-972f-d8bc2d72480b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.436446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:57:39.438171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 412/800] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:39.439194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.474831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.475893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.476325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.476734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.490149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.492236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.514571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:39.516676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 389/801] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:39.517711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.550784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796bfb4-b083-4b8d-a1fe-3add976f6fa4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.585356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.586213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.586593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.586961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.588246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:39.588646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.590299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.608981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 413/802] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:39.610119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.643952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ac768-d095-438a-b3b4-9f5cf0d9f26f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.678765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.679739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.680194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.680638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.681714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:39.682223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.683777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.692795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 390/803] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:39.693878 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.722673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc71fa-cb1a-4d57-9b11-2723a86e0ef8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.757155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.757855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.758241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.758600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.759433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:39.759813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.761273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.778199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 414/804] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:39.779178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.796043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc8bd-a3bb-4a8e-a398-ea19b0007546 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.836732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.837882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.838338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.838785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.849551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.851272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.865719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:39.867257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 391/805] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:39.868246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.898500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b859754-cb69-485e-9ff0-941ad043113b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:39.933533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:39.934354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:39.934636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:39.934909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:39.946705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:39.948217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:39.968807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:39.970099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 415/806] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:39.970889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:39.979034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369752-504f-4752-9135-f7cfba6accdf None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.026758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.027422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.027699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.027967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.035382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.036840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.050387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-704c03a1-2aab-42b8-b21f-282abe8dba2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:40.056322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 392/807] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:40.057779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9c2b-df49-4e8c-a864-8da4636590ae None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.058054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9c2b-df49-4e8c-a864-8da4636590ae None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.058317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9c2b-df49-4e8c-a864-8da4636590ae None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.060279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 393/808] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:40.060987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9c2b-df49-4e8c-a864-8da4636590ae None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.087950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd781f-75fe-40e8-b407-25e91f7e794e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.126908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.128294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.129111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.129845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.130851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:40.131382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.133699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.147202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 416/809] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:40.150206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.173251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9c2b-df49-4e8c-a864-8da4636590ae None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.213091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.213748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.214054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.214337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.215050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:40.215349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.216721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9444d0-3cdd-40d7-b591-2d2f7a0efdc0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.229229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 394/810] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:40.230546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.230826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.231101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.249529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:40.251320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:40.268596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358c2d2-5ba1-42c7-8483-730e06851583 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.302015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.302601 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.302885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.303159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.304196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:40.304515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.305988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.317844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 417/811] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:40.318344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 395/812] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:40.319219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.329564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.414321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5369f-c211-4c62-9f16-bab90dbd936e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.422507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ab5c9-bcd2-4d6e-bc64-336a575961e3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.448176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.448997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.449264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.449533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.453540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.454416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.454686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.454954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2237e08b136e422aa924acb345f90b9d/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.456352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.457836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.468781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=2237e08b136e422aa924acb345f90b9d, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.470220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.471853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-fcc5480c-c942-4944-addb-28cabfaa0afd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:57:40.473050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 396/813] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:40.474347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b6ce2-acc0-4745-afa8-5a5360d73072 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.474604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b6ce2-acc0-4745-afa8-5a5360d73072 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.474845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b6ce2-acc0-4745-afa8-5a5360d73072 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.476490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 397/814] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:40.477186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b6ce2-acc0-4745-afa8-5a5360d73072 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.487870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 418/815] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:40 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2237e08b136e422aa924acb345f90b9d/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:40.488695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.596675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409d177-d689-404a-983d-d2cbdb2e3aec None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.601162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b6ce2-acc0-4745-afa8-5a5360d73072 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.634858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.635694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.635973 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.636250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.636920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.638042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f3d0-6abc-4fb4-b4f6-498d8eb308d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.638320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.638935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f3d0-6abc-4fb4-b4f6-498d8eb308d0 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.639212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f3d0-6abc-4fb4-b4f6-498d8eb308d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.639485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f3d0-6abc-4fb4-b4f6-498d8eb308d0 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/a9357bd3de9b4dbebed74a1dcd6420c4/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.641643 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838f3d0-6abc-4fb4-b4f6-498d8eb308d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=a9357bd3de9b4dbebed74a1dcd6420c4, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.643273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838f3d0-6abc-4fb4-b4f6-498d8eb308d0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.650929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 04 05:57:40.657294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 419/816] 10.222.0.30 () {56 vars in 1129 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:40.657294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.664714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 398/817] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:40 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/a9357bd3de9b4dbebed74a1dcd6420c4/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:40.674590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.674900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.675130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.702939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:40.704204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:40.786113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 399/818] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:40.787011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.789326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5379-996e-48c1-9522-b284f3de1e6f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.828544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.829278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.829556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.829828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.830772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:40.831078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.832580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.855872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 420/819] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:40.856982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.914739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36ef58-cf94-4f4c-8633-5f718d3ebbc4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.949390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.949874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.950154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.950426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.951134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:40.951437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.952808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:40.957903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 400/820] 10.222.0.30 () {56 vars in 1124 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:40.958817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:40.959096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e1cbe-82e2-465b-a809-1cae4744aeef None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:40.992817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:40.993948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:40.994390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:40.994792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] PATH_INFO: `/v3/services/network` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:40.995577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:40.997108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.008357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 04 05:57:41.010128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 421/821] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:41.011037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.067769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7c3c-873f-4bfc-ae96-309107dd7d83 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.101832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.102460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.102741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.103015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.110146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf69f-eb3c-4d5a-bdf0-0d174aaf8833 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.144036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.144962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.145389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.145798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.147033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:41.147472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.148988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.154299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 422/822] 10.222.0.30 () {56 vars in 1124 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:41.155207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.174616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.176099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.254652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e7ce2-ab02-43ed-91ba-2d2e31715f14 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.274039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 401/823] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:57:41.274880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.288243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.289202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.289617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.290019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.291220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] RBAC: Adding query filter params (name=network) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:41.291737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.293268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.298836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 423/824] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:41.299862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.399215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9133-0e25-4274-8745-4c8dfb79111f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.400265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0805e-f392-4d38-bcbc-c97fc869a8bd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.433589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.434545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.434920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.435373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.441533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.442795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.443219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.443633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.444886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.446469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.446873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.448240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.465824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:41.467589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 424/825] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:41.468528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.475962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 402/826] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:57:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:41.477538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.591561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2f15-aebc-454b-bddb-8c78ceaace8a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.598293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac5731-2d78-4cde-9a5d-a76a143fa624 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.632531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.633361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.633951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.633951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.634767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:41.635132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.636598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.646784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.648238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.648994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.649519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.650417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] RBAC: Adding query filter params (type=network) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:41.650893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.651271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 403/827] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:41.652659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.658807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 425/828] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:41.660154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.663927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:41.780321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d46f-3437-4983-b0f4-93348e189b16 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.821255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5a63-9d90-4fea-a1e0-1f031cda7b14 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:41.822469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.823378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.824063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.824509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.826410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.828033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.858102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 426/829] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:57:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:57:41.876566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:41.877849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:41.878311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:41.878727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:41.887717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:41.889568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:41.906060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:41.908091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 404/830] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:41.913759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:42.029142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b406-1f54-4225-8351-05e372ff98c6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:42.065382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:42.066155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:42.066434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:42.066704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:42.067499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:42.067801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:42.069255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25563e-6042-461d-9bd1-810d9a5af648 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:42.082362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 427/831] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:42.088177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:42.202562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bff10-c7e5-4fc5-9294-e1fcd2eae7c6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:42.243405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:42.244067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:42.244345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:42.244619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:42.245478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=07287811d9ef4e04bd62a665d642b61d) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:42.245784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:42.247231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fbcbd-905e-4c93-8dd6-548f69282833 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:42.255742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 405/832] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:42 2022] GET /identity/v3/role_assignments?user.id=07287811d9ef4e04bd62a665d642b61d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:43.046464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0ba31-034e-44f3-b198-f1dbd3c09f76 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.046981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0ba31-034e-44f3-b198-f1dbd3c09f76 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.046981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0ba31-034e-44f3-b198-f1dbd3c09f76 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.049117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 428/833] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:43.054791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fba26-a6c7-4f13-b305-1f237da85dbe None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.055249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fba26-a6c7-4f13-b305-1f237da85dbe None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.055324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fba26-a6c7-4f13-b305-1f237da85dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.072667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-239fba26-a6c7-4f13-b305-1f237da85dbe None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:43.073921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-239fba26-a6c7-4f13-b305-1f237da85dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:43.140261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e971cf-9e8a-4cd6-817b-1e4bdcf1c568 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.140495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e971cf-9e8a-4cd6-817b-1e4bdcf1c568 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.140769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e971cf-9e8a-4cd6-817b-1e4bdcf1c568 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.141252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 406/834] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:43.143943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 429/835] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:43.148684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.149001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.149276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.166267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:43.166689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e971cf-9e8a-4cd6-817b-1e4bdcf1c568 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.167423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:43.233881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 407/836] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:43.258151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.274707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e971cf-9e8a-4cd6-817b-1e4bdcf1c568 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.311289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.312094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.312367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.312626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.322815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:43.330014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 05:57:43.331912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 430/837] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:43.337347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.369831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185172e-d923-42dd-ad11-a41da062d11c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.404386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.405168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.405443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.405709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.416544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:43.423498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:57:43.429960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 408/838] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:43.431212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.459980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583f93-fdc8-4725-85d7-10b5bd53c1f9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.505124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.506190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.506693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.507164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.508112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:43.508614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:43.510237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:43.524011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 431/839] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:43.525265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.540092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0434cb-3ec4-4e6a-b206-31022eb5ceb8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.573274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.573956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.574231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.574495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.575292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:43.575575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:43.577019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:43.590004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 409/840] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:43.591340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.625622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45394cd1-ec81-4539-806c-d2841f5b2a55 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.660010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.661186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.661690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.662157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.673033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:43.674840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:43.690839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb952-7881-4c09-a035-ebc0394e6fb4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.692060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:43.698430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 432/841] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:43.699501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.725475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.726275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.726592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.726862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.737916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:43.739414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:43.756116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:43.762090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 410/842] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:43.763338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.801717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997cbcb-edd3-45b7-a0b8-5fcf7f415b04 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.837922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.838986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.839492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.839961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.840988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:43.841544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:43.843175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:43.862855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 433/843] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:43.864179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.878883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58b90e-62ca-4724-9ee5-1dae7f91a352 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.913454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:43.914033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:43.914342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:43.914609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:43.915338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:43.915792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:43.917066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:43.933077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 411/844] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:43.935195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:43.965611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2cc50-b0b4-46ed-827e-a880f293d54c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:43.999537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.000732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.001261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.001731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.012105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.013886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.029472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 04 05:57:44.035761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 434/845] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:44.036840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.039398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ab977-82da-4fea-97d2-5146d7920923 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.073761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.074561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.075005 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.075414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.083161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.084836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.099601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 04 05:57:44.105946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 412/846] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:57:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:44.107396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.138187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb1de-d98d-4a3b-a8b7-540498b7d9ec None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.173471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.174617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.175099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.175568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.176610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:44.177247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.178990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.201011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 435/847] 10.222.0.30 () {56 vars in 1149 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:44.203419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.208077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e4069-c28f-4e7d-a9aa-aada211eeaab None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.242355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.243034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.243314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.243586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.244428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:44.244736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.246221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742425-0082-4890-ae9f-685ca554117c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.271852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 413/848] 10.222.0.30 () {56 vars in 1135 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:44.271852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ab2a-e8f8-4ec3-a8d2-fc2599973527 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.271852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ab2a-e8f8-4ec3-a8d2-fc2599973527 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.271852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ab2a-e8f8-4ec3-a8d2-fc2599973527 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.271852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 414/849] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:44.275382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ab2a-e8f8-4ec3-a8d2-fc2599973527 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.321219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97394-d6d0-493f-80d0-a59d722b8421 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.353351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae12d-714e-475f-89ba-fca87255ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.354001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae12d-714e-475f-89ba-fca87255ef16 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.354281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae12d-714e-475f-89ba-fca87255ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.354552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae12d-714e-475f-89ba-fca87255ef16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.380070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ab2a-e8f8-4ec3-a8d2-fc2599973527 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.414608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.415516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.415957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.416370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.420078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae12d-714e-475f-89ba-fca87255ef16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.421594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae12d-714e-475f-89ba-fca87255ef16 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.488761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.490187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.517062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 436/850] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 04 05:57:44.518812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.519288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.519743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.536849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:44.538041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:44.599466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 415/851] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 04 05:57:44.600335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.610377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 437/852] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:44.612242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.702955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96e99-4698-410b-a6a1-f33eaeebb26b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.707088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6111e-6c55-4e9f-a447-6d3e054c15d2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.736019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.736876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.737186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.737457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.740383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.741137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.741412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.741680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.747357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.748806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.751322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.753166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.765345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-0f29a364-bb48-41c7-b6dd-eb6f20c51635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:44.766537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 416/853] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:44.767762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66b2f-977e-41c0-a899-88f41e4ac0f8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.768043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66b2f-977e-41c0-a899-88f41e4ac0f8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.768318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66b2f-977e-41c0-a899-88f41e4ac0f8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.769335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:44.775294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 417/854] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:44.775436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 438/855] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:44.775539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f66b2f-977e-41c0-a899-88f41e4ac0f8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.775624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.871433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982101d7-485d-48aa-b814-e5619b517c0d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.874719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f66b2f-977e-41c0-a899-88f41e4ac0f8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:44.905341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.906005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.906281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.906556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.907277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:44.907574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.908511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:44.909207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.909326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.909623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.909888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.910528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:44.911872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:44.920302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 439/856] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:44.921108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:44.922629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-2658fa82-ad73-44ba-a6cd-21966e9871a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 04 05:57:44.929408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 418/857] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:44.929408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:44.929408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:44.929408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:44.942766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:44.943873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:45.010892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 419/858] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:45.011649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.031571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a24c3-fd05-41f0-aa13-89c24fe3e634 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.064270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.066982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.067252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.067505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.068219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.068515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.069944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.081938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 440/859] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.082722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.105996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68271a-2f94-4de2-b5f1-a79890205fc1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.139492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.140295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.140567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.140822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.148093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.149581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.162598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:45.163809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 420/860] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:45.164564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.176947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8a998-3fd5-436e-bd66-3dd97d9f8a0d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.209611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.210272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.210567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.210830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.211526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.211826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.213304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.218866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 441/861] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.220038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.263370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d9d9-d768-4464-8756-ca5879bc0978 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.295390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.296182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.296447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.296732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.297405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.298776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.310231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 04 05:57:45.311366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 421/862] 10.222.0.30 () {56 vars in 1132 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:45.312123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.317321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4769c5c-d9ca-4703-bbad-d45d7eca02b1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.350094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.350886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.351159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.351424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.357926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.359351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.372299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:45.373468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 442/863] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:45.374216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.418814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6e64a-70c6-4107-8f50-ee78eb0729a0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.450437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.451052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.451326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.451593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.452363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.452661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.454128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.466064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 422/864] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.466726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.470139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da645f-0452-40d0-9770-8bf7051006b4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.504064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.504743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.505038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.505307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.506035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.506309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.507694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.512150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 443/865] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.512920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.570453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc03dbb-f293-4771-80f6-97046f9fec10 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.608393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.609103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.609385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.609659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.610374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.610721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.612150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.621737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 423/866] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.621737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.628516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62f9e-b73f-4571-8b10-11734323c3f7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.663825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.664506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.664801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.665107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.665913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.666223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.667696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.680927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 444/867] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.681878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.739686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324765e4-2930-4fef-9de5-a4813a72a00d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.776406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.777096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.777376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.777647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.778478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2237e08b136e422aa924acb345f90b9d) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.778798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.780252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.783442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94375-4a1c-4a7c-8521-42f07667a1b1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.786342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 424/868] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/role_assignments?user.id=2237e08b136e422aa924acb345f90b9d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.797287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:45.831523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.832519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.833046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.833488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.835028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.835588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.837725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8e936-4318-48fb-bd67-7be488f3ab8c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.844072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 445/869] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:45.938054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297ef50-9140-49ce-a102-4a2160379618 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:45.977872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:45.978555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:45.978841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:45.979116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:45.979978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=a9357bd3de9b4dbebed74a1dcd6420c4) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:45.980290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:45.981859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f810d-dadf-415a-8196-bb286d32bec8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:45.990606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 425/870] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:45 2022] GET /identity/v3/role_assignments?user.id=a9357bd3de9b4dbebed74a1dcd6420c4&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:47.819698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8aa74-806d-4b1a-9b61-359fdbb112aa None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:47.820339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8aa74-806d-4b1a-9b61-359fdbb112aa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:47.820339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8aa74-806d-4b1a-9b61-359fdbb112aa None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:47.822353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 446/871] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:47.828040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5982-d030-401f-a730-939186374044 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:47.828521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5982-d030-401f-a730-939186374044 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:47.828602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c5982-d030-401f-a730-939186374044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:47.847746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-471c5982-d030-401f-a730-939186374044 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:47.849106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-471c5982-d030-401f-a730-939186374044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:47.925014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 426/872] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:47.944030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8aa74-806d-4b1a-9b61-359fdbb112aa None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.053271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8aa74-806d-4b1a-9b61-359fdbb112aa None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.088652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff783-1c0c-4cb6-a01d-372d52e3f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.089260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff783-1c0c-4cb6-a01d-372d52e3f8ba None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.089544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff783-1c0c-4cb6-a01d-372d52e3f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.089825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff783-1c0c-4cb6-a01d-372d52e3f8ba None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.090563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff783-1c0c-4cb6-a01d-372d52e3f8ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:48.091957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff783-1c0c-4cb6-a01d-372d52e3f8ba None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:48.113108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 447/873] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:57:47 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:48.217464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8eac-abb0-4b3f-8468-811c3ca1002c None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.217811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8eac-abb0-4b3f-8468-811c3ca1002c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.218029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8eac-abb0-4b3f-8468-811c3ca1002c None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.220251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 427/874] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:48.223489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15548ea-c029-46f3-ae90-a7523dea50ad None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.223781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15548ea-c029-46f3-ae90-a7523dea50ad None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.224063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15548ea-c029-46f3-ae90-a7523dea50ad None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.226281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 448/875] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:48.227820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.228207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.228582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.231754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cfc2e-6621-4e25-94c6-72e7b67b9369 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.232041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cfc2e-6621-4e25-94c6-72e7b67b9369 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.232325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cfc2e-6621-4e25-94c6-72e7b67b9369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.249088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:48.249764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d83cfc2e-6621-4e25-94c6-72e7b67b9369 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:48.250549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:48.250957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d83cfc2e-6621-4e25-94c6-72e7b67b9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:48.334411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 449/876] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:48.336477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad959-eaec-475e-88a9-67e6213ee6ee None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.336757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad959-eaec-475e-88a9-67e6213ee6ee None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.337147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad959-eaec-475e-88a9-67e6213ee6ee None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.338801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 450/877] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:48.341001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 428/878] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:48.348118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.348467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.348829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.363344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.368110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:48.369318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:48.436271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 451/879] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:48.437578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.460529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92db6-0355-4c83-a9cb-b2fdf6a0072e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.493665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.494340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.494616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.494890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.495613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:48.497027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:48.513927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 429/880] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:57:48 2022] POST /identity/v3/services => generated 269 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:57:48.514915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.555916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6cebd-3890-4664-92c8-e2a505459dc0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.604751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.605747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.606098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.606440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.618430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:48.626691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 04 05:57:48.633518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 452/881] 10.222.0.30 () {56 vars in 1120 bytes} [Mon Apr 4 05:57:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:48.634942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.635051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e6ed-35b7-4d43-8456-0eeb8ae646d4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.681247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.682841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.683319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.684037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.685193 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:48.686972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:48.707068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 04 05:57:48.710090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 430/882] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:48.715990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.754563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c699f6-0a6a-45fb-b235-4b02564b0db2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.801202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.802025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.802422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.802701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.803624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:48.803930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:48.806145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:48.817155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 453/883] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:57:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:48.824353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.842900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e57b7-6afa-4831-bc9c-30e8e2119287 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.875976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.876564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.877189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.877189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.877904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:48.878208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:48.879603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:48.884766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 431/884] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:57:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:48.889867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:48.930643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b0e9-af5e-4089-9558-9f07e28d6abd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.964716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:48.965574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:48.965854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:48.966127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:48.977564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:48.979070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:48.990515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225b31d-7ec5-435d-b1ae-6de1a725e0e7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:48.996578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:49.003373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 454/885] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:49.004461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:49.026561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:49.027239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:49.027524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:49.027797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:49.028514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:49.028815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:49.030233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:49.035208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 432/886] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:57:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:49.118050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5507eed-72ec-426b-8914-6b174b3e7179 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:49.156483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:49.157101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:49.157382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:49.157657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:49.158605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:49.159063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:49.160698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:49.174968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 455/887] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:49.180853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:49.287688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4ef05-4fac-4777-bbdf-68d02d824331 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:49.321172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:49.321998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:49.322275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:49.322545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:49.330666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:49.332442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:49.347662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 04 05:57:49.349320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 433/888] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:57:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:49.355299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:49.457495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96130-2b29-4859-b777-d60e2e4ba6e8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:49.491360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:49.492032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:49.492310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:49.492579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:49.493446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:49.493749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:49.495172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:49.512868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 456/889] 10.222.0.30 () {56 vars in 1149 bytes} [Mon Apr 4 05:57:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:49.519083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:49.619233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d0344-5276-4248-9df8-6262396f21a2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:49.653382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:49.654040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:49.654318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:49.654593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:49.722820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:49.724217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:49.826997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 434/890] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:57:49.833163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:49.932323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613248e4-651f-433e-96f0-c2747e52f63f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:49.966055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:49.966860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:49.967137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:49.967411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:49.977804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:49.979194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:49.996336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:49.997855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 457/891] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:50.003627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:50.108324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3294a-d386-40df-b793-62b60ca6d9e1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:50.143320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:50.144188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.144465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.144740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.145507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:50.146172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:50.147584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:50.160195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 435/892] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:50.165758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:50.274371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea9cf1-5c30-4fbc-a4ac-34fb8542e918 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:50.307819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:50.308667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.308955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.309227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.316328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:50.317814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:50.332409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:50.333974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 458/893] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:50.339491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:50.446144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489aabd-7e1d-4b76-a602-c9822f64242b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:50.480194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:50.480863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.481169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.481446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.482233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:50.482536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:50.483971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635996c6-b40f-4124-8cfe-ca4f055ea719 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:50.496867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 436/894] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:50.503289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:50.572067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff154db-dd75-43cb-ba7a-493b1dcc5b30 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.572067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff154db-dd75-43cb-ba7a-493b1dcc5b30 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.572067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff154db-dd75-43cb-ba7a-493b1dcc5b30 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.576957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 437/895] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:50.580000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.580352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.580753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.598825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:50.600042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:50.614492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9807-b1ee-451a-8a7f-8f0b3276207e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:50.659084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:50.659747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.660022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.660290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.661151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] RBAC: Adding query filter params (role.id=cb6dbcfb32a1435f952b72f0e77d7220, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2237e08b136e422aa924acb345f90b9d) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:50.661456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:50.662895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:50.668718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 459/896] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:57:50 2022] GET /identity/v3/role_assignments?user.id=2237e08b136e422aa924acb345f90b9d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=cb6dbcfb32a1435f952b72f0e77d7220 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:50.673557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 438/897] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:50.699071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:50.811759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beebb58-9e66-4b76-b29c-6477f20cc7df None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:50.857370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:50.859091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.859520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.859934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.860743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:50.862388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:50.874502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-45612ef6-50ba-4d59-bb6e-a2509f43bdea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 04 05:57:50.876392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 460/898] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:50.882824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:50.976396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18e8ac-a35f-440c-b449-99ac089c8e1a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.977055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18e8ac-a35f-440c-b449-99ac089c8e1a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.977520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18e8ac-a35f-440c-b449-99ac089c8e1a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.980495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 461/899] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:50.985885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:50.986536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:50.987450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:50.990836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98a08b-4a8d-4fd5-9dda-a2865c9efd66 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.004867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:51.006558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:51.028550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.029303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.029631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.029906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.030632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:51.030937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.032483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.042872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 439/900] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:51.044464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.101253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 462/901] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:51.117087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.162127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30623cef-13fe-4a09-bff4-80e7af137630 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.195579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.196501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.196943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.197358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.198183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:51.198662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.200168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.205541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 440/902] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:51.211264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.224837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d478e-d9be-428a-aa2e-ad4e8e2d228a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.265016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.266025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.266342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.266610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.267645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.269330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.284512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 04 05:57:51.290642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 463/903] 10.222.0.30 () {56 vars in 1132 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:51.292078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.325895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f667add-53d3-4cc8-aa40-b8a4899820d5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.360065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.360645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.360937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.361669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.362540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] RBAC: Adding query filter params (interface=public, service_id=4a64422aa9424392b8c73dd7ab597aa0, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:51.362887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.364408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.374128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 441/904] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/endpoints?service_id=4a64422aa9424392b8c73dd7ab597aa0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:51.375211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.406868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dc4d-7b8b-478b-bef7-0e3b375be2cd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.445930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.446589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.446860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.447146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.447895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:51.448196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.449623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6f85c-b4ae-4837-80e7-85cb9f94eb00 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.455147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 464/905] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:51.456627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e884-1545-4c31-a4e4-a3b643c62d90 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.456923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e884-1545-4c31-a4e4-a3b643c62d90 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.457209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e884-1545-4c31-a4e4-a3b643c62d90 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.458839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 465/906] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:51.463532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e884-1545-4c31-a4e4-a3b643c62d90 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.484334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54db270-48ab-41ed-a7c1-ca32a0681897 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.518967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea1bae-92aa-47c2-ae54-498b0403bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.519637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea1bae-92aa-47c2-ae54-498b0403bba1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.519912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea1bae-92aa-47c2-ae54-498b0403bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.520182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea1bae-92aa-47c2-ae54-498b0403bba1 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.521245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea1bae-92aa-47c2-ae54-498b0403bba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.522626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea1bae-92aa-47c2-ae54-498b0403bba1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.535137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 442/907] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 05:57:51.535137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.535137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.535137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.552654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:51.554346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:51.579142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e884-1545-4c31-a4e4-a3b643c62d90 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.619013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.619656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.619930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.620254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.621001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:51.621354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.622857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.630724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 466/908] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:51.637202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.642949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 443/909] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:51.666077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.755556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f7ad-1755-4f16-a1b6-91997f13e806 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.786852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bcb34-ef03-4b0d-befe-af3347c477d1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.790760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.791703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.792175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.792634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.793643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] RBAC: Adding query filter params (interface=public, service_id=fb0ccf17e3a349c9a9309646d180ccbf, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:51.794168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.795737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.803896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 467/910] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/endpoints?service_id=fb0ccf17e3a349c9a9309646d180ccbf&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:51.809825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:51.824934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e76515-7d0a-48b3-8bce-bbc81ca53566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.825479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e76515-7d0a-48b3-8bce-bbc81ca53566 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.825756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e76515-7d0a-48b3-8bce-bbc81ca53566 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.826023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e76515-7d0a-48b3-8bce-bbc81ca53566 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.826768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e76515-7d0a-48b3-8bce-bbc81ca53566 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.828109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e76515-7d0a-48b3-8bce-bbc81ca53566 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.850942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 444/911] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:57:51 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:57:51.942310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15ecf-ff00-43de-aa77-51371af58e98 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:51.984582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c071dd2-8b65-43d4-a70f-c4aef9c037bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:51.985347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c071dd2-8b65-43d4-a70f-c4aef9c037bf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:51.985630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c071dd2-8b65-43d4-a70f-c4aef9c037bf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:51.985943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c071dd2-8b65-43d4-a70f-c4aef9c037bf None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:51.986915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c071dd2-8b65-43d4-a70f-c4aef9c037bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:51.988392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c071dd2-8b65-43d4-a70f-c4aef9c037bf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:51.995377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 468/912] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:57:51 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 05:57:53.068429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916752df-9d93-45c3-9099-2de00fe882c6 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.068987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916752df-9d93-45c3-9099-2de00fe882c6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.068987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916752df-9d93-45c3-9099-2de00fe882c6 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.071260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 445/913] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:53.076795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.077662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.078130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.096328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:53.097896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:53.168482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 469/914] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:53.192535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916752df-9d93-45c3-9099-2de00fe882c6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:53.296059 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916752df-9d93-45c3-9099-2de00fe882c6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:53.330450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:53.331654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.332138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.332615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.343696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:53.351590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 04 05:57:53.353316 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 446/915] 10.222.0.30 () {56 vars in 1120 bytes} [Mon Apr 4 05:57:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:53.359488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:53.460489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025c1ed-4e2f-4b34-9748-ffa0afc01c42 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:53.495680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:53.496720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.497218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.497701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.498659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:53.499153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:53.500706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:53.510054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 470/916] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:57:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:53.516252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:53.622452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4cd96-09e2-4cfe-8a25-70ed2e09f4c3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:53.658046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:53.659419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.659897 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.660365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.671094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:53.672836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:53.690852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:53.692687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 447/917] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:53.698558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:53.805591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5dece-2dca-44a3-bb64-96f4b3004f06 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:53.841393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:53.842427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.842919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.843386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.844322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:53.844816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:53.847184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135a58-03a9-4787-8f26-ff1421da99dc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:53.859818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 471/918] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:53.865603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:53.896752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4445772-54bb-48aa-ab42-0667012c38c6 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.896976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4445772-54bb-48aa-ab42-0667012c38c6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.897383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4445772-54bb-48aa-ab42-0667012c38c6 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.900586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 472/919] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:53.907467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:53.907751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:53.908232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:53.929660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:53.931581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:53.985604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9cbb4-87c5-45bb-a2d9-ff4b44eb1794 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.020938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 473/920] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:54.031395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.032218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.032496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.032876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.038936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.049597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.051954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.070451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 04 05:57:54.078060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 448/921] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:57:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:54.079146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.142663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba214e8-2724-42c2-8455-9ccf5e184ab4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.178544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.179574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.180014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.180419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.181309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.182889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.183342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfdfc6-c4f2-4713-97a3-d694fdf6ea4b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.194501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 04 05:57:54.196322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 474/922] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:54.203093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.226729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.228031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.228683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.229604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.230945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:54.231604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.234023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884202b-6c5a-4ff3-9d32-5969ef99e9e3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.255381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 449/923] 10.222.0.30 () {56 vars in 1149 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:54.257031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4538a45-58aa-4ac3-b9ca-a6f5ff744f7d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.257508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4538a45-58aa-4ac3-b9ca-a6f5ff744f7d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.257967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4538a45-58aa-4ac3-b9ca-a6f5ff744f7d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.260018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 450/924] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:54.260972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4538a45-58aa-4ac3-b9ca-a6f5ff744f7d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.304617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0cf91-b684-4fef-a0dc-0f34e76dd02a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.338780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.339447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.339724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.339993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.340765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:54.341110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.342489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064ea1e-591e-42a8-a109-9f86144e829d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.347171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 475/925] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:54.348369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.348652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.348941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.358930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4538a45-58aa-4ac3-b9ca-a6f5ff744f7d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.364638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:54.365846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:54.390780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.391575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.391852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.392227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.402432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.403861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.420444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-67bd2269-b3ec-4c0b-889d-7d716d39407e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:54.421608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 451/926] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:54.422783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd58d1-4a31-4ee1-af62-2f1c587b5905 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.423067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd58d1-4a31-4ee1-af62-2f1c587b5905 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.423338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd58d1-4a31-4ee1-af62-2f1c587b5905 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.425582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 452/927] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:54.426514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd58d1-4a31-4ee1-af62-2f1c587b5905 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.429042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 476/928] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:54.433832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.523810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd58d1-4a31-4ee1-af62-2f1c587b5905 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.526653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d05e2-587e-4d5b-a3a4-f1ee15220e82 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.557210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.557868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.558140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.558409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.559076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:54.559370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.560740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4326db4-eca7-49e3-97fe-62068c1b322c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.562267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.562934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.563209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.563481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.564831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:54.565167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.565615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 453/929] 10.222.0.30 () {56 vars in 1114 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:54.566515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.566770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.567051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.567319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.578178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 477/930] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:54.578986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.584171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:54.585390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:54.654721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 454/931] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:54.655533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.673933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ccd40-24d7-4125-b19e-dbb45a404135 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.706248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.707073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.707410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.707740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.708397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.709806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.720840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 04 05:57:54.722009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 478/932] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:54.722756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.752246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf62c-d5f1-46c4-82b9-1e82ed194df5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.784687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.785477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.785813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.786165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.786957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.788399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.813292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 455/933] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:57:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:54.814493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.819178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdbb5-d414-422d-aef8-f319b21a734e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.863489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.864301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.864572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.864835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.872276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.873782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.888358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:54.889654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 479/934] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:54.890433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:54.927460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9255b-eca4-4067-b5c8-0e155d4b3469 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:54.962278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:54.963030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:54.963324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:54.963586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:54.964251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:54.965718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:54.978019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 04 05:57:54.979446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 456/935] 10.222.0.30 () {56 vars in 1132 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:54.980149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.001632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9512d-e263-4a1c-a580-5fd4fe4f114d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.039024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.039722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.039990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.040242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.041013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:55.041314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.042693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.047951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 480/936] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:55.048203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.093212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8a67a-1136-4ef5-a863-81ea374d343a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.126156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.126909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.127187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.127458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.128229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:55.128525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.129991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.142012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 457/937] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:55.143302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.150378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6e59d-6059-489d-806d-637596c4b454 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.183516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.184191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.184466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.184733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.185471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:55.185771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.187107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.196630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 481/938] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:55.196630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.239746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5ec72-edad-40e8-815e-2ab4881642e4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.273348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.274018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.274293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.274568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.275263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:55.275563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.276951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.281610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 458/939] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:57:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:55.282356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.296933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c39670-8077-4ced-b115-13368f874722 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.334907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.336040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.336320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.336592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2237e08b136e422aa924acb345f90b9d/roles/cb6dbcfb32a1435f952b72f0e77d7220` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.338934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=2237e08b136e422aa924acb345f90b9d, role_id=cb6dbcfb32a1435f952b72f0e77d7220)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.340372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.364931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 482/940] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:57:55 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2237e08b136e422aa924acb345f90b9d/roles/cb6dbcfb32a1435f952b72f0e77d7220 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:57:55.364931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.412323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8edac-4ace-43ea-87e3-2082e1808c8e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.458470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.459791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.460299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.460975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.462220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:55.462736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.464355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.476446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 459/941] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:55.478308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.488844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422cfea-808b-4907-864c-daaf27dc8b78 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.528189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.528789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.529096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.529406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.530210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] RBAC: Adding query filter params (interface=public, service_id=163cc53fbf10417d9b20474f34be2824, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:55.530506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.532007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.538816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 483/942] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:57:55 2022] GET /identity/v3/endpoints?service_id=163cc53fbf10417d9b20474f34be2824&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:55.547493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:55.610739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e4d4-8fa7-44e2-b878-fecf9b19c29f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.646557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ece54-6666-424f-a2bb-108f1d840bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.647556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ece54-6666-424f-a2bb-108f1d840bd1 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.648021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ece54-6666-424f-a2bb-108f1d840bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.648451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ece54-6666-424f-a2bb-108f1d840bd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.649385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ece54-6666-424f-a2bb-108f1d840bd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.650954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ece54-6666-424f-a2bb-108f1d840bd1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.672833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977d309-e39b-4379-80b7-4fc4da35c61f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:55.677249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 460/943] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:57:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:55.724468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797db31-f086-46c4-a8af-9812f8821421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:55.725490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797db31-f086-46c4-a8af-9812f8821421 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:55.725981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797db31-f086-46c4-a8af-9812f8821421 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:55.726439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797db31-f086-46c4-a8af-9812f8821421 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:55.727357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797db31-f086-46c4-a8af-9812f8821421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:55.729019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797db31-f086-46c4-a8af-9812f8821421 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:55.736993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 484/944] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:57:55 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 05:57:57.154705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931675a8-94cf-45c2-bebe-2fb4713562e9 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.155292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931675a8-94cf-45c2-bebe-2fb4713562e9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.155292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931675a8-94cf-45c2-bebe-2fb4713562e9 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.157094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 461/945] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:57.162633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.163042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.163229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.180326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:57.181541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:57.246615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 485/946] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:57.272169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931675a8-94cf-45c2-bebe-2fb4713562e9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:57.375170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931675a8-94cf-45c2-bebe-2fb4713562e9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:57.413593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:57.414591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.415058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.415519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.416440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:57.418100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:57.419774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.common [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 04 05:57:57.437653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.sql.core [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 04 05:57:57.437653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 04 05:57:57.437653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [parameters: {'id': '06a4092f38ed4f1f8d244669656ceacd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 04 05:57:57.437653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79967) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 04 05:57:57.445297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 06a4092f38ed4f1f8d244669656ceacd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 06a4092f38ed4f1f8d244669656ceacd. Apr 04 05:57:57.447173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 462/947] 10.222.0.30 () {60 vars in 1140 bytes} [Mon Apr 4 05:57:57 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:57.453173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:57.551886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7a39-762f-494c-951a-39f1fffc61cf None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:57.585851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:57.587006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.587493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.588040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.595322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:57.597035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:57.612359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-7aad739f-b344-478e-9d3c-2f0038de7d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:57.614255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 486/948] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:57.620526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:57.727889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58e12-3c39-4e0f-9d90-68a9a3a2f285 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:57.764666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:57.765794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.766264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.766722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.767839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:57.768415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:57.770842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:57.773508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff5b1-71e2-47ec-aebf-56d941d7c33d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.774281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff5b1-71e2-47ec-aebf-56d941d7c33d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.774740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff5b1-71e2-47ec-aebf-56d941d7c33d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.777577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 487/949] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:57.786627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ccd4-9fc3-4ed8-b3be-f955e560d741 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:57.787202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ccd4-9fc3-4ed8-b3be-f955e560d741 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:57.787660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ccd4-9fc3-4ed8-b3be-f955e560d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:57.795677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 463/950] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:57.810256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9ed4ccd4-9fc3-4ed8-b3be-f955e560d741 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:57.811660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9ed4ccd4-9fc3-4ed8-b3be-f955e560d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:57.900130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 488/951] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:57:57.925489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.031676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8470469-0330-4c77-b5bf-b01d44c1a148 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.047422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8bc28-2833-4d40-b542-75bf95f691ec None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.047697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8bc28-2833-4d40-b542-75bf95f691ec None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.047968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8bc28-2833-4d40-b542-75bf95f691ec None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.050141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 489/952] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:57:58.055256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9daa98-79df-4722-968f-9b18175a2d7d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.055537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9daa98-79df-4722-968f-9b18175a2d7d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.055809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9daa98-79df-4722-968f-9b18175a2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.069376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.070268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.070554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.070826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.073610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4f9daa98-79df-4722-968f-9b18175a2d7d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:58.074782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4f9daa98-79df-4722-968f-9b18175a2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:58.081532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:57:58.089391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 04 05:57:58.090896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 464/953] 10.222.0.30 () {56 vars in 1120 bytes} [Mon Apr 4 05:57:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:58.099829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.158847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 490/954] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:58.160195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7bea-037e-4248-8604-e59ef0ad9436 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.160479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7bea-037e-4248-8604-e59ef0ad9436 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.160754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7bea-037e-4248-8604-e59ef0ad9436 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.162699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 491/955] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:57:58.174572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.174938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.175283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.191941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:57:58.193167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:57:58.207718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b5e73-8a45-4411-94f2-279b8098df34 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.244144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.244927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.245625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.245897 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.246650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:58.246957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.248348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.257185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 465/956] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:58.257996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.258718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 492/957] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:57:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:57:58.262610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.368709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffdde5-feff-44d0-8a21-dd5622f6857c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.368966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d60d8-0b04-4ae6-8429-8c2dae39471b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.402369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.403177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.403460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.403737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.404385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.405743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.405861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.406863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.407341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.407889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.416669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 04 05:57:58.418929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 466/958] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:58.418929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.422868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.424558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.441789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:58.443107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 493/959] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:58.443756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.525045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9a981-2b16-49d7-9c41-e60e423a4039 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.543213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6190-9c14-4293-bb3d-c838d8c1895f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.558506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.559325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.559604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.559881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.560534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.561963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.573275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 04 05:57:58.574479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 467/960] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:58.575197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.581431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.582326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.582803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.583232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.584117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:58.584628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.586191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.596192 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 494/961] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:58.597118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.674451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71384d19-e802-4b19-9cfd-3889a933bc6b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.694896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85646e-98d9-4b75-aed6-f3cf3b07f825 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.710266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.710938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.711357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.711635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.712643 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:58.712973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.714398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.728226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 468/962] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:58.729422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.733039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.733741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.734023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.734295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.735004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:58.735307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.736764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.746255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 495/963] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:58.746255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.838093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9fa0-3eaa-4259-b9b7-e91204cbc03f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.843896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5ae45-9820-4614-b176-971cc02cff4c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:58.876009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.876217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:58.877059 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.877244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:58.877478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.877578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:58.877755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.877861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:58.878462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:58.878764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.880151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.893095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 469/964] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:58.893325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:58.893407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:58.893475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:58.909842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 04 05:57:58.911424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 496/965] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:58.916926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:59.004250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9156c5-2a2a-4ede-a18e-f84eef68f771 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.043037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.043739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.044014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.044289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.045057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:59.045364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.046796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.052582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 470/966] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:59.053054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152fa4d-5fd9-4d61-9351-623a2f9b929d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.061973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:59.090361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.090361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.090361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.090719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.091422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:59.091723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.093310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.111169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 497/967] 10.222.0.30 () {56 vars in 1149 bytes} [Mon Apr 4 05:57:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:57:59.118307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:59.178359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045fbbe-2661-41aa-ace0-0fc899b356d0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.214754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.216197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.216674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.217194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.218116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.219679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.226307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c1700-c03d-490c-9d1b-883f98099618 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.249337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 471/968] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:57:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:57:59.269345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.269924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.270203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.270842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.347473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.348995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.458245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 498/969] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:57:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:57:59.464136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:59.568173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dda9a-99d0-4e18-a482-1ea39e1fd196 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.601302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.602170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.602449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.602720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.614634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.616122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.633053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:57:59.634594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 472/970] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:57:59.642242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:59.738901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663d4c3-0ef8-4a06-8c66-9af4cbbd8aeb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.773522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.774569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.775059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.775518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.776418 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:57:59.776917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.778567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.790640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 499/971] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:57:59.796473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:57:59.899949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e737-4b48-4c00-a223-19caa453b09c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:57:59.933096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:57:59.933893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:57:59.934169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:57:59.934438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:57:59.941525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:57:59.942967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:57:59.956441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:57:59.957961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 473/972] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:57:59.963715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:00.062269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ef3e-38cc-4441-9c04-ea6becb9c8c3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:00.098785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:00.099796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.100160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.100473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.101929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:00.102446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:00.104286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fcfa4-0942-4166-b5aa-8fabbb71edee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:00.120833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 500/973] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:00.126806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:00.216983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a39f-5c10-4169-b49f-0757fce0be82 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.217330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a39f-5c10-4169-b49f-0757fce0be82 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.217525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a39f-5c10-4169-b49f-0757fce0be82 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.219505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 501/974] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:00.224643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.224940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.225213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.226734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a638-a5c0-4ed4-bb79-2a0340b080a6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:00.242339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:00.243524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:00.260546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:00.261228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.261505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.261773 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.262594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] RBAC: Adding query filter params (role.id=cb6dbcfb32a1435f952b72f0e77d7220, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2237e08b136e422aa924acb345f90b9d) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:00.262896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:00.264370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:00.271150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 474/975] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:00 2022] GET /identity/v3/role_assignments?user.id=2237e08b136e422aa924acb345f90b9d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=cb6dbcfb32a1435f952b72f0e77d7220 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:00.314712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 502/976] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:00.339814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:00.447945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1905114-0040-4635-8236-f34c59d3f796 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:00.485427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57258-0012-4016-bef1-765439365689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:00.486143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57258-0012-4016-bef1-765439365689 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.486420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57258-0012-4016-bef1-765439365689 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.486829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57258-0012-4016-bef1-765439365689 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.487571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57258-0012-4016-bef1-765439365689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:00.489041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57258-0012-4016-bef1-765439365689 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:00.503023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.sql.core [None req-1fa57258-0012-4016-bef1-765439365689 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 04 05:58:00.503023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 04 05:58:00.503023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [parameters: {'user_id': '91c69bcd89eb4f91be47663fd8a89a74', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 04 05:58:00.503023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79967) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 04 05:58:00.509057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-1fa57258-0012-4016-bef1-765439365689 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 04 05:58:00.510703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 475/977] 10.222.0.30 () {60 vars in 1131 bytes} [Mon Apr 4 05:58:00 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:00.516561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:00.616349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b53cfb-8803-427a-96d0-6a91b86102be None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:00.649743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:00.650806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.651222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.651626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.659273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:00.660884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:00.675351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-4c5adb86-49a1-4de0-bec0-de25a8aae478 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 04 05:58:00.681103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 503/978] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:00.683157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57258-0012-4016-bef1-765439365689 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:00.786383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57258-0012-4016-bef1-765439365689 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:00.821528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:00.822203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:00.822478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:00.822746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:00.823554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:00.823853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:00.825592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61c6d4-400f-4627-875a-8a777224f136 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:00.863812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 476/979] 10.222.0.30 () {56 vars in 1101 bytes} [Mon Apr 4 05:58:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:01.296643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e30f31-f7e3-4cb1-a0d9-3af8c0a7b553 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:01.297263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e30f31-f7e3-4cb1-a0d9-3af8c0a7b553 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:01.297263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e30f31-f7e3-4cb1-a0d9-3af8c0a7b553 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:01.299162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 504/980] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:01.305706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070597d5-76e9-434d-b636-604c1079bf8b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:01.306246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070597d5-76e9-434d-b636-604c1079bf8b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:01.306246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070597d5-76e9-434d-b636-604c1079bf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:01.325210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-070597d5-76e9-434d-b636-604c1079bf8b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:01.326725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-070597d5-76e9-434d-b636-604c1079bf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:01.392570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 477/981] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:01.416030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e30f31-f7e3-4cb1-a0d9-3af8c0a7b553 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:01.521403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e30f31-f7e3-4cb1-a0d9-3af8c0a7b553 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:01.554505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a845b-72f1-419d-8b85-f32950089311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:01.555096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a845b-72f1-419d-8b85-f32950089311 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:01.555375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a845b-72f1-419d-8b85-f32950089311 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:01.555643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a845b-72f1-419d-8b85-f32950089311 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:01.556363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a845b-72f1-419d-8b85-f32950089311 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:01.557760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a845b-72f1-419d-8b85-f32950089311 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:01.580928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 505/982] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:58:01 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:01.654063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c61b-4ddc-43f5-9157-19aef698de75 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:01.654314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c61b-4ddc-43f5-9157-19aef698de75 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:01.654576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c61b-4ddc-43f5-9157-19aef698de75 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:01.656426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 478/983] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:01.662586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:01.662899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:01.663165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:01.681602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:01.682839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:01.759494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 506/984] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:01.782357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9c61b-4ddc-43f5-9157-19aef698de75 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:01.887973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9c61b-4ddc-43f5-9157-19aef698de75 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:01.921449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:01.922266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:01.922538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:01.922816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:01.923585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:01.925006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:01.936478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 04 05:58:01.937666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 479/985] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:58:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:01.944169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:02.043315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631104b5-1cce-46ba-bcd9-23d9c0eb9eba None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:02.077094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:02.077763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.078041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.078293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.078997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:02.079351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:02.080762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:02.085691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 507/986] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:58:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:02.091269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:02.190402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb193f1-903b-4631-9626-2d72c8f7d5e4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:02.224036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:02.224702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.224982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.225281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.225960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:02.226266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:02.227679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:02.232873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 480/987] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:58:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:02.238762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:02.342691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e57a-ed04-4c74-93bc-7dd72e3d9e54 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:02.376939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:02.377621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.377902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.378133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.378963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=163cc53fbf10417d9b20474f34be2824, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:02.379272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:02.380658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33396-33de-49b8-a37c-e9ff48af14b8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:02.390492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 508/988] 10.222.0.30 () {56 vars in 1249 bytes} [Mon Apr 4 05:58:02 2022] GET /identity/v3/endpoints?service_id=163cc53fbf10417d9b20474f34be2824&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:02.391810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:02.491752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d884ca8-f0d0-4f8f-98d8-080a450be6c1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:02.525199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5953760-64b1-41b0-b549-60a69955b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:02.525873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953760-64b1-41b0-b549-60a69955b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.526149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953760-64b1-41b0-b549-60a69955b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.526423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5953760-64b1-41b0-b549-60a69955b6d5 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.527101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5953760-64b1-41b0-b549-60a69955b6d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:02.528523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5953760-64b1-41b0-b549-60a69955b6d5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:02.535748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 481/989] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:58:02 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 05:58:02.643672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3b7f7-0550-4c56-889b-97c696f56f47 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.644040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3b7f7-0550-4c56-889b-97c696f56f47 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.644218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3b7f7-0550-4c56-889b-97c696f56f47 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.646638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 509/990] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:02.652449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.652742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.653049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.671436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:02.672686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:02.750140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 482/991] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:02.772653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3b7f7-0550-4c56-889b-97c696f56f47 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:02.877011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3b7f7-0550-4c56-889b-97c696f56f47 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:02.912391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:02.913210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:02.913453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:02.913741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] PATH_INFO: `/v3/services/image` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:02.914381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:02.915746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:02.926663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 04 05:58:02.928162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 510/992] 10.222.0.30 () {56 vars in 1105 bytes} [Mon Apr 4 05:58:02 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:02.933971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:03.030306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c0f5-a222-43eb-b463-bb496954596c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:03.062633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:03.063293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:03.063568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:03.063994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:03.064834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] RBAC: Adding query filter params (name=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:03.065164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:03.066528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856ecd-daec-43f1-8041-725059a7daa6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:03.071429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 483/993] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:03.076887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:03.171697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d172c-9fed-4779-8392-e9f65bc860cc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:03.204725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:03.205417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:03.205690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:03.205952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:03.206642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] RBAC: Adding query filter params (type=image) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:03.206935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:03.208289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4327f-8d9d-4303-8558-38b47e3f85a7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:03.212943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 511/994] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:03.888572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e657a-8666-4bff-9a29-86562f43ecd2 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:03.889103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e657a-8666-4bff-9a29-86562f43ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:03.889212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e657a-8666-4bff-9a29-86562f43ecd2 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:03.891007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 484/995] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:03.896839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:03.897280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:03.897459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:03.914710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:03.915904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:03.993796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 512/996] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:04.016199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e657a-8666-4bff-9a29-86562f43ecd2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:04.117010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e657a-8666-4bff-9a29-86562f43ecd2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:04.152741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:04.153559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.153842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.154112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.154760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:04.156137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:04.167033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 04 05:58:04.168411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 485/997] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:58:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:04.174475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:04.272010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289962a-ab00-48fc-94cf-a2e82ad4d6b2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:04.306383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:04.307049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.307324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.307595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.308276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:04.308594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:04.309994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:04.319849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 513/998] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:58:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:04.321115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:04.431559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cccaf-5818-403f-a7a5-11d665a6c942 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:04.465499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:04.466475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.466966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.467412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.468320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:04.468801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:04.470560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:04.476112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 486/999] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:58:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:04.481738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:04.586019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f04d5-6260-440e-9a54-d523aafd6148 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:04.620038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:04.620700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.621011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.621287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.622071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] RBAC: Adding query filter params (interface=public, service_id=5fac5c25d0314caf9d84421bd4f68ae8, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:04.622381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:04.623751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61108af2-5983-4833-b624-afd4e9926816 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:04.629194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 514/1000] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:58:04 2022] GET /identity/v3/endpoints?service_id=5fac5c25d0314caf9d84421bd4f68ae8&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:04.634564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:04.732727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5e793-c682-41be-a65d-4bf0ba204d13 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:04.765614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d1744-82d0-4763-9db9-2dfd215fa3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:04.766279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1744-82d0-4763-9db9-2dfd215fa3cc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.766552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1744-82d0-4763-9db9-2dfd215fa3cc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.766923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1744-82d0-4763-9db9-2dfd215fa3cc None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.767608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d1744-82d0-4763-9db9-2dfd215fa3cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:04.769078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d1744-82d0-4763-9db9-2dfd215fa3cc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:04.775903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 487/1001] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:58:04 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 05:58:04.883903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c297192-2a0e-4f7f-b016-01e1625cd442 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.884268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c297192-2a0e-4f7f-b016-01e1625cd442 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.884444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c297192-2a0e-4f7f-b016-01e1625cd442 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.886309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 515/1002] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:04.892716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:04.893314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:04.893389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:04.912315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:04.913564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:04.986629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 488/1003] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:05.009871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c297192-2a0e-4f7f-b016-01e1625cd442 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:05.111037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c297192-2a0e-4f7f-b016-01e1625cd442 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:05.143753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:05.144557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.144830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.145120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.146137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:05.147541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:05.159379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 04 05:58:05.166001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 516/1004] 10.222.0.30 () {56 vars in 1126 bytes} [Mon Apr 4 05:58:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:05.167109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:05.265657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1d31-49bf-4eb4-b3d3-bdd396146595 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:05.298520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:05.299189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.299465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.299727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.300426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:05.300725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:05.302112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:05.306908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 489/1005] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:58:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:05.312616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:05.411870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b172c3-d008-446e-a847-08b1cb43d7b7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:05.444816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:05.445505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.445786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.446054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.446755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:05.447108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:05.448493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599e919-0521-4a10-b492-df8f580e1e23 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:05.453464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 517/1006] 10.222.0.30 () {56 vars in 1122 bytes} [Mon Apr 4 05:58:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:05.459183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:05.523081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814c34-979b-4ca3-84f7-c28e256301e5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.523374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814c34-979b-4ca3-84f7-c28e256301e5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.523561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814c34-979b-4ca3-84f7-c28e256301e5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.525683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 518/1007] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:58:05.530563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.530812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.531122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.549798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:05.550989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:05.563581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5634-1ced-44b8-9bec-3d3cab9a9551 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:05.602558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea60a-978e-4ff4-9db8-59431bfeb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:05.603229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea60a-978e-4ff4-9db8-59431bfeb5d1 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.603801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea60a-978e-4ff4-9db8-59431bfeb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.603801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea60a-978e-4ff4-9db8-59431bfeb5d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.604518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ea60a-978e-4ff4-9db8-59431bfeb5d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:05.605917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ea60a-978e-4ff4-9db8-59431bfeb5d1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:05.617823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 519/1008] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:05.627920 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 490/1009] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:58:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:05.641335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:05.749068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a9086-1138-4466-8b5c-dda13637ca60 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:05.791070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05110f03-cb93-49bb-8dd3-8648729c90ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:05.791666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05110f03-cb93-49bb-8dd3-8648729c90ce None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:05.791945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05110f03-cb93-49bb-8dd3-8648729c90ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:05.792215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05110f03-cb93-49bb-8dd3-8648729c90ce None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:05.792955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05110f03-cb93-49bb-8dd3-8648729c90ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:05.794379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05110f03-cb93-49bb-8dd3-8648729c90ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:05.820276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 520/1010] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:58:05 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:07.091166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae922d82-38e2-496d-9490-3b1037807862 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:07.091705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae922d82-38e2-496d-9490-3b1037807862 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:07.091705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae922d82-38e2-496d-9490-3b1037807862 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:07.093679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 491/1011] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:07.098935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:07.099336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:07.099412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:07.116513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:07.117703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:07.188956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 521/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:07.211686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae922d82-38e2-496d-9490-3b1037807862 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:07.318844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae922d82-38e2-496d-9490-3b1037807862 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:07.353393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:07.354118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:07.354385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:07.354654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:07.355369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:07.356813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:07.367958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 04 05:58:07.369390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 492/1013] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:58:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:07.375230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:07.472109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814089c5-f934-4265-84b4-9fb40bfe3048 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:07.506784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:07.507903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:07.508359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:07.508827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:07.509751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] RBAC: Adding query filter params (name=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:07.510243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:07.511786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:07.521970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 522/1014] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:58:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:07.523599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:07.625727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671e3df-02c9-422e-85eb-6c6949523cb0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:07.664346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:07.665394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:07.665858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:07.666329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:07.667326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:07.667809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:07.669452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411b571-87c2-4f7a-9679-ec61eab48101 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:07.675639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 493/1015] 10.222.0.30 () {56 vars in 1112 bytes} [Mon Apr 4 05:58:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:07.681349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:07.780278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9c161-c961-4085-bb83-8ef4f33bd44b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:07.819747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1767a9-c8b6-40a6-98b4-a7ea0c050725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:07.820406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1767a9-c8b6-40a6-98b4-a7ea0c050725 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:07.820681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1767a9-c8b6-40a6-98b4-a7ea0c050725 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:07.820980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1767a9-c8b6-40a6-98b4-a7ea0c050725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:07.821716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1767a9-c8b6-40a6-98b4-a7ea0c050725 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:07.823071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1767a9-c8b6-40a6-98b4-a7ea0c050725 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:07.849108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 523/1016] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:58:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:08.019286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11793e-91f3-45a9-9698-8e009324a196 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.019474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11793e-91f3-45a9-9698-8e009324a196 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.019709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11793e-91f3-45a9-9698-8e009324a196 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.022094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 494/1017] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:08.027841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.028129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.028402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.046943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:08.048150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:08.124180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 524/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:08.148432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.148628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818b1e9-a320-44f2-accf-98a94fafad1d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.149108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818b1e9-a320-44f2-accf-98a94fafad1d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.149188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818b1e9-a320-44f2-accf-98a94fafad1d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.151125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 495/1019] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:08.156076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.156380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.156647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.176724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:08.177958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:08.244916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 496/1020] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:08.251176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97257c5-799c-4c10-80b5-67ff811a2fde None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:08.267549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.286833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:08.287565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.287842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.288511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.289999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:08.291890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:08.294559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 525/1021] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:08.299602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.366041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a7c56-115e-47a7-98ed-fda330d4fdc2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:08.393725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2162-fd19-495b-87e2-71353bd38278 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:08.399129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:08.399923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.400195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.400464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] PATH_INFO: `/v3/services/image` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.401133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:08.402493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:08.413330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 04 05:58:08.414654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 497/1022] 10.222.0.30 () {56 vars in 1105 bytes} [Mon Apr 4 05:58:08 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:08.420302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.431723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:08.432352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.432629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.432919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.433621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:08.435034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:08.469121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 526/1023] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:58:08 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:58:08.527407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563727e0-623e-44e4-adf7-01de54bd5d8a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:08.563688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:08.564375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.564646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.564945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.565658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] RBAC: Adding query filter params (name=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:08.565959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:08.567377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:08.572930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 498/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:08.578827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.682139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff641-81a4-41f3-a28a-089aaa17b1a4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:08.717194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:08.717854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.718127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.718391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.719094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] RBAC: Adding query filter params (type=image) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:08.719414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:08.720887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:08.725614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 527/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:08.731514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.831371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e015b8-0839-4df2-a3dd-c0dd48b78386 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:08.864305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:08.864992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:08.865274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:08.865547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:08.866336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] RBAC: Adding query filter params (interface=public, service_id=c9eec1f04dbd4aa58fa1ec692827c5ac, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:08.866647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:08.868065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466e959-0ec2-4d3d-89b7-1e555ec8f1c0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:08.873257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 499/1026] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 05:58:08 2022] GET /identity/v3/endpoints?service_id=c9eec1f04dbd4aa58fa1ec692827c5ac&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:08.878991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:08.979415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65ec11-9811-4bd0-b5de-62f1c1518b1f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:09.013320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ecc49-bb07-48f4-aa11-35dd57cce834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:09.013980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ecc49-bb07-48f4-aa11-35dd57cce834 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:09.014264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ecc49-bb07-48f4-aa11-35dd57cce834 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:09.014536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ecc49-bb07-48f4-aa11-35dd57cce834 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:09.015221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ecc49-bb07-48f4-aa11-35dd57cce834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:09.016625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ecc49-bb07-48f4-aa11-35dd57cce834 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:09.023811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 528/1027] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 05:58:08 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 05:58:10.261800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8900-18fd-46fe-a4b4-dba3b5b7441e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.262317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8900-18fd-46fe-a4b4-dba3b5b7441e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.262317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf8900-18fd-46fe-a4b4-dba3b5b7441e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.264015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 500/1028] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:10.269860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.270633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.270733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.288619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:10.289834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:10.355018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 529/1029] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:10.378804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8900-18fd-46fe-a4b4-dba3b5b7441e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:10.491568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf8900-18fd-46fe-a4b4-dba3b5b7441e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:10.526302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:10.527051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.527331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.527600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.538704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:10.545985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 04 05:58:10.547393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 501/1030] 10.222.0.30 () {56 vars in 1120 bytes} [Mon Apr 4 05:58:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:10.553803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:10.653488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784cc6b-3bfe-420b-9b23-8800b56fd040 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:10.688667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:10.689370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.689655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.689958 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.690710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:10.691012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:10.692398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfafac4-270d-49ca-b863-ebdac9da455a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:10.700405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 530/1031] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:58:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:10.706323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:10.788545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd1fd-b0bf-481c-8c8e-9dec6807cd8b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.788732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd1fd-b0bf-481c-8c8e-9dec6807cd8b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.788993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccd1fd-b0bf-481c-8c8e-9dec6807cd8b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.790906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 531/1032] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:58:10.796099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.796380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.796647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.808997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ff8f-38a3-4cf8-ad49-12a4f97d9003 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:10.814519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:10.815747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:10.843887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:10.845177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:10.845458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:10.845732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:10.856076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:10.857566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:10.874055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:10.875452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 502/1033] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:10.880866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:10.892935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 532/1034] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:10.910989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:10.978850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05478ed-0050-4ffd-b57f-ceede1764505 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.009762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18d380-8176-49c8-ba0f-8d6f8a339672 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.013921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.014814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.015284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.015744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.016696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:11.017301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.018694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.030725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 503/1035] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:11.036344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.043722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.044458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.044739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.045048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.046246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.047744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.049694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 533/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:11.054987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.132270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cad0b-e453-4b74-b86d-e031a9c821eb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.159184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfb4b-1e4c-4fdc-a128-5a8be8f7e652 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.164609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.165443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.165720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.165991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.173916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.175371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.188420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:58:11.189866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 504/1037] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:11.195325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.195573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ceeb6-f32d-4f69-bd9e-f2b61512982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.196297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ceeb6-f32d-4f69-bd9e-f2b61512982a None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.196514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ceeb6-f32d-4f69-bd9e-f2b61512982a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.196777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ceeb6-f32d-4f69-bd9e-f2b61512982a None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.197509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ceeb6-f32d-4f69-bd9e-f2b61512982a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.198917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ceeb6-f32d-4f69-bd9e-f2b61512982a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.221472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 534/1038] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:58:11 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 05:58:11.305819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded522b7-6277-4fdd-a2eb-ea319406dfdc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.336220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280fd2-986c-4379-a707-33cdbb3ac595 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.336747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280fd2-986c-4379-a707-33cdbb3ac595 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.336747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b280fd2-986c-4379-a707-33cdbb3ac595 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.338759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 535/1039] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:58:11.342067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.342800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.343032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.343306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.344165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:11.344273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.344498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.344610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.344950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.346172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.362368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:11.363579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:11.366199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 505/1040] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:11.372111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.441217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 536/1041] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:11.464241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.481601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742fda-9f92-4aca-b8be-7e43c353e02e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.516001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.517065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.517397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.517670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.564876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f6b44-5c1c-4854-9b2c-be446cff696e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.584959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.586420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.598942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.599735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.600008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.600278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] PATH_INFO: `/v3/services/image` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.600950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.602300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.612957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 04 05:58:11.614294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 537/1042] 10.222.0.30 () {56 vars in 1105 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:11.620267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.688506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 506/1043] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:11.694242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.719755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5846bd6-04be-4999-91c0-94abd69e3849 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.794248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d84b7-2b7b-42be-9343-613c6b890c71 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.832448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.833630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.834128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.834627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.847009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.848545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.866182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:11.867616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 507/1044] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:11.873128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.880158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:11.880824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:11.881131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:11.881391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:11.882093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] RBAC: Adding query filter params (name=image) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:11.882380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:11.883741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:11.888563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 538/1045] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:11.894156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:11.972760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892518da-b579-4950-b5fc-997b3d0a093c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:11.987980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1dcc0-4a7f-4c59-b729-e60f750b808e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:12.007099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:12.007769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:12.008050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:12.008317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:12.009066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:12.009366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:12.010745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:12.021903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:12.022427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 508/1046] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:12.022629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:12.022906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:12.023175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:12.023933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:12.024249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:12.025606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:12.027885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:12.030531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 539/1047] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:12.035967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:12.132448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b99e17-4da2-4ec2-bbdd-f4c3fc80ffc0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:12.134443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80318895-ac3c-40f7-bdd1-c735797623e7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:12.166779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:12.167964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:12.168441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:12.168948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:12.169063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:12.169663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:12.169937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:12.170200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:12.170943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:12.172295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:12.178192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:12.180789 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:12.193384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 540/1048] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 05:58:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:12.195735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:58:12.197210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 509/1049] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:12.203528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:12.316358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799911b-01e2-415f-9701-fdeff738f29c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:12.352246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:12.353056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:12.353220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:12.353461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:12.354252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:12.354548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:12.355991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6dd8-af48-48c8-8f13-bc9403e61130 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:12.368617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 541/1050] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:12.374689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:12.479142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43e4d5-42ea-4e7e-91be-5043c101d3a0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:12.514694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:12.515345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:12.515621 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:12.515888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:12.516760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] RBAC: Adding query filter params (role.id=cb6dbcfb32a1435f952b72f0e77d7220, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=07287811d9ef4e04bd62a665d642b61d) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:12.517153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:12.518569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36a30a-bc6a-4a85-96b4-6faffcde2708 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:12.532928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 510/1051] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:12 2022] GET /identity/v3/role_assignments?user.id=07287811d9ef4e04bd62a665d642b61d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=cb6dbcfb32a1435f952b72f0e77d7220 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:13.594089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe6d9-78c0-4038-8c25-b02166f1b756 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:13.594715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe6d9-78c0-4038-8c25-b02166f1b756 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:13.594715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fe6d9-78c0-4038-8c25-b02166f1b756 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:13.596657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 542/1052] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:13.602061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:13.602504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:13.602594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:13.619919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:13.621126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:13.691165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 511/1053] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:13.714275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe6d9-78c0-4038-8c25-b02166f1b756 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:13.821892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fe6d9-78c0-4038-8c25-b02166f1b756 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:13.856252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:13.857084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:13.857363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:13.857628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:13.867981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:13.874798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:58:13.881399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 543/1054] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:13.882268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:13.981810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a66613-c0e6-4c5f-8aa2-de42f9ac8c39 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:14.016050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:14.016796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.017212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.017490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.018289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:14.018598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:14.019971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:14.029016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 512/1055] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:14.034858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:14.132402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64723-b38a-4adf-b1bd-be02098cc452 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:14.170336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17adae4-c4c2-44d5-b786-b8d04d6149cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:14.171231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17adae4-c4c2-44d5-b786-b8d04d6149cd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.171505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17adae4-c4c2-44d5-b786-b8d04d6149cd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.171772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17adae4-c4c2-44d5-b786-b8d04d6149cd None admin] PATH_INFO: `/v3/users/3bd7def91c3e47c3930738972c865831` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.185918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17adae4-c4c2-44d5-b786-b8d04d6149cd None admin] RBAC: Authorizing `identity:get_user(user_id=3bd7def91c3e47c3930738972c865831)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:14.187465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17adae4-c4c2-44d5-b786-b8d04d6149cd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:14.194572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 544/1056] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/users/3bd7def91c3e47c3930738972c865831 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:14.196924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:14.296722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aca60-5a79-4693-9dd6-a3bd5837c608 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:14.330680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:14.331334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.331616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.331888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.401197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:14.402580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:14.505909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 513/1057] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:14.510799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d17f21-ee36-468a-af47-01984bff3987 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.511084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d17f21-ee36-468a-af47-01984bff3987 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.511351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d17f21-ee36-468a-af47-01984bff3987 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.511472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:14.513285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 545/1058] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:14.518549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.518845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.519098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.535981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:14.537182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:14.601410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 546/1059] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:14.615609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c00fe-cd62-4a1c-8b8d-986d187cbe9e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:14.623380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:14.649785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:14.650651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.650924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.651191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.652411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] RBAC: Authorizing `identity:get_project(project_id=159a12b46c4b473383c9a187a0bf6954)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:14.653804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:14.655637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 514/1060] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:14.661556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:14.721051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682abcc6-43e5-472b-9274-d5d392766d0c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:14.753929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:14.754583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.754850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.755120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.760425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b9fbe-5664-42b5-8853-e591e937bdc2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:14.793650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:14.794318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.794586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.794841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.795669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=159a12b46c4b473383c9a187a0bf6954, user.id=3bd7def91c3e47c3930738972c865831) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:14.795975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:14.797511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a82d65-4417-42ba-8ee7-b9ddfa07ec09 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:14.805880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 515/1061] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/role_assignments?user.id=3bd7def91c3e47c3930738972c865831&scope.project.id=159a12b46c4b473383c9a187a0bf6954&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:14.831633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:14.833179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:14.838608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6c1e-ad45-482b-bc36-087bccc8d57d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.838845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6c1e-ad45-482b-bc36-087bccc8d57d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.839150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6c1e-ad45-482b-bc36-087bccc8d57d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.843051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 516/1062] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:58:14.849384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:14.849626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:14.849908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:14.867609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:14.868825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:14.943909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 517/1063] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:14.946423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 547/1064] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 04 05:58:14.952382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:14.967329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.053233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6ae36-fa5d-4c22-a5b2-7cd99af0b492 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.065527 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0869-b061-40e1-9a99-3969484d7332 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.087892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.088703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.089020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.089407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.100164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.101649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.102963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.104373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.104787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.105243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.116203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:15.118415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:15.119625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 518/1065] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:15.124154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 04 05:58:15.125451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.125872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 548/1066] 10.222.0.30 () {56 vars in 1120 bytes} [Mon Apr 4 05:58:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:15.131595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.222730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff14cb0-6506-48bb-9c10-dd5da3a99fc5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.228988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6a7e6-e2a0-4d4b-bd50-bcd77256e368 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.258014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.258677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.258949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.259222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.259933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:15.260236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.261665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.262504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.263544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.264399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.264867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.265805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:15.266373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.267883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.273501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 519/1067] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:15.277028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 549/1068] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:15.282991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.390249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f156d90-b6f3-4225-87d1-5d7b2a674a6a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.431292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.432116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.432399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.432670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.444421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.445940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.463312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:15.464550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 520/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:15.470547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.576383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5d282-e14f-46bf-95ab-29bb123bd723 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.607992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.608650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.609160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.609258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.609975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:15.610273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.611629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.623029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 550/1070] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:15.629067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.727342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1cd45-e984-41e4-b92a-2ae5eb9edb9c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.760940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.761752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.762033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.762303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.770401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.771837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.785276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:58:15.786642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 521/1071] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:15.792544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:15.891226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc379c-0a50-461a-ba32-448638ef9028 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:15.925361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:15.926034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:15.926308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:15.926573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:15.927382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:15.927679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:15.929140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:15.948206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 551/1072] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:15.954543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:16.053634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffc1a5-e774-4df7-b50d-7fa7e8778a0a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:16.086783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:16.087564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:16.087843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:16.088109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:16.101667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:16.103054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:16.119466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:16.120645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 522/1073] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:16.126526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:16.227002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab0936-2bd1-45de-9828-7bbb483e6749 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:16.263350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:16.264004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:16.264283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:16.264554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:16.265310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:16.265616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:16.266978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:16.278589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 552/1074] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:16.284631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:16.386062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01efa-9f14-4b17-b33f-022245bcfbfa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:16.419811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:16.420604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:16.420879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:16.421173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:16.428077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:16.429555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:16.443559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:58:16.444721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 523/1075] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:16.450766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:16.548465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5dbb5-695e-443d-b7c7-44182c5161cd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:16.581777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:16.582424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:16.582701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:16.582968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:16.583739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:16.584041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:16.585500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50d4e7-2af7-48a0-9b69-37d9a9d21df8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:16.597052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 553/1076] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:16.603305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:16.707243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d7288-7613-4da9-95c7-1ca026cb3542 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:16.743624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff9c3b-1cf4-43e7-acb2-3abcc2c96bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:16.744519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff9c3b-1cf4-43e7-acb2-3abcc2c96bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:16.744803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff9c3b-1cf4-43e7-acb2-3abcc2c96bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:16.745114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff9c3b-1cf4-43e7-acb2-3abcc2c96bf2 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/07287811d9ef4e04bd62a665d642b61d/roles/cb6dbcfb32a1435f952b72f0e77d7220` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:16.747439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff9c3b-1cf4-43e7-acb2-3abcc2c96bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=07287811d9ef4e04bd62a665d642b61d, role_id=cb6dbcfb32a1435f952b72f0e77d7220)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:16.748927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff9c3b-1cf4-43e7-acb2-3abcc2c96bf2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:16.765689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 524/1077] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:58:16 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/07287811d9ef4e04bd62a665d642b61d/roles/cb6dbcfb32a1435f952b72f0e77d7220 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:58:17.142594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c857-eb4c-44f3-9e38-912d1afca294 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:17.143169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c857-eb4c-44f3-9e38-912d1afca294 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:17.143169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c857-eb4c-44f3-9e38-912d1afca294 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:17.145306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 554/1078] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:17.150712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:17.151000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:17.151281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:17.168865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:17.170089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:17.238699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 525/1079] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:17.261172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c857-eb4c-44f3-9e38-912d1afca294 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:17.359588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c857-eb4c-44f3-9e38-912d1afca294 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:17.392050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:17.392886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:17.393137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:17.393403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:17.403492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:17.410836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:58:17.412019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 555/1080] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:17.418339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:17.522858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bcfb-b0c3-4cbd-9731-b334f0449f4d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:17.556443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:17.557141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:17.557415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:17.557685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:17.558430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:17.558729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:17.560092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:17.569482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 526/1081] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:17.575599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:17.678503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b085aa-4a82-433a-9087-5388ba7d68ec None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:17.711501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:17.712366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:17.712643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:17.712928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] PATH_INFO: `/v3/users/3bd7def91c3e47c3930738972c865831` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:17.714143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd7def91c3e47c3930738972c865831)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:17.715577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:17.717207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 556/1082] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:17 2022] GET /identity/v3/users/3bd7def91c3e47c3930738972c865831 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:17.723590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:17.829639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98c267-9f2e-464c-a24d-e0e4baa27f42 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:17.865306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27205-52ff-4a69-beea-229b6e205da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:17.866178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27205-52ff-4a69-beea-229b6e205da7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:17.866462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27205-52ff-4a69-beea-229b6e205da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:17.866736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27205-52ff-4a69-beea-229b6e205da7 None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:17.868002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27205-52ff-4a69-beea-229b6e205da7 None admin] RBAC: Authorizing `identity:get_project(project_id=159a12b46c4b473383c9a187a0bf6954)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:17.869518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27205-52ff-4a69-beea-229b6e205da7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:17.871277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 527/1083] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:17 2022] GET /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:17.878207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:17.977463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0db2-f2ea-4f1e-a57d-b3de4bb501f8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:18.010185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d2a29-2128-4fca-8dce-48732ca00e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:18.011072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2a29-2128-4fca-8dce-48732ca00e1e None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:18.011342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2a29-2128-4fca-8dce-48732ca00e1e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:18.011610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2a29-2128-4fca-8dce-48732ca00e1e None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954/users/3bd7def91c3e47c3930738972c865831/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:18.013614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d2a29-2128-4fca-8dce-48732ca00e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=159a12b46c4b473383c9a187a0bf6954, user_id=3bd7def91c3e47c3930738972c865831, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:18.015038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d2a29-2128-4fca-8dce-48732ca00e1e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:18.029458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 557/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:58:17 2022] PUT /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954/users/3bd7def91c3e47c3930738972c865831/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:58:19.042246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a03e-3855-4b20-95ac-fe92c9b7c70b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.042770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a03e-3855-4b20-95ac-fe92c9b7c70b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.042770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6a03e-3855-4b20-95ac-fe92c9b7c70b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.044580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 528/1085] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:19.049929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.050395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.050493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.067517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:19.068682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:19.137633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 558/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:19.162381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6a03e-3855-4b20-95ac-fe92c9b7c70b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:19.267573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6a03e-3855-4b20-95ac-fe92c9b7c70b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:19.301500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:19.302311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.302595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.302862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.313720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:19.321050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 04 05:58:19.322246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 529/1087] 10.222.0.30 () {56 vars in 1120 bytes} [Mon Apr 4 05:58:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:19.328432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:19.425405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cfe85-2021-48a5-9c27-bdeb32081c51 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:19.459225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:19.459887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.460167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.460433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.461208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:19.461504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:19.462866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:19.470963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 559/1088] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:58:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:19.476804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:19.586128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e44e8-b8f2-440a-b8b0-afecaa2b7a51 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:19.621196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:19.622026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.622305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.622563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.632873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:19.634720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:19.652070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:19.653291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 530/1089] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:19.659217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:19.758410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65228e-7440-4195-bfd4-1c1df0b8b7a9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:19.794215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:19.794876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.795151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.795416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.796129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:19.796427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:19.797917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:19.814872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 560/1090] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:19.816124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:19.915634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf5bed-45d0-447d-835e-eafd6d3abe13 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:19.950067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:19.950853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:19.951110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:19.951377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:19.959897 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:19.961455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:19.978086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 04 05:58:19.979389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 531/1091] 10.222.0.30 () {56 vars in 1093 bytes} [Mon Apr 4 05:58:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:19.985686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.084510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d502e-af40-487d-9715-55792fa18ed6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.118059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.118712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.118984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.119250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.120067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:20.120366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.121808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef83b-faf6-4f81-8d56-f61686a7d8bf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.138596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 561/1092] 10.222.0.30 () {56 vars in 1133 bytes} [Mon Apr 4 05:58:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:20.144459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.244917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c5b0a-bdc6-4cf8-9dcd-e68739f8f93d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.282052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.282708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.282982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.283260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.349994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.351350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.354349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534d4bb-56c0-492c-b394-6eaaf7c6705e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.354614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534d4bb-56c0-492c-b394-6eaaf7c6705e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.354909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534d4bb-56c0-492c-b394-6eaaf7c6705e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.356674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 562/1093] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 05:58:20.362176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.362487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.362742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.379734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:20.380932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:20.445384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 532/1094] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:20.450420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 563/1095] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:20.451141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.475169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.551163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb79a-72de-40c8-bff1-1a320cfde22c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.572699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7f4cb-2d14-4bc1-a505-42be285b8ee0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.588878 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.590061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.590528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.591031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.605729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.608152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.612500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.613331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.613605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.613867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.624082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:20.626054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 05:58:20.627258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 533/1096] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:20.631637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:58:20.632807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 564/1097] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 05:58:20.632985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.638855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.729293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05686087-3ebb-4478-8cce-90272a433653 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.738227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde43f7b-e1f8-4267-a638-43561f7fed22 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.763622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.764305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.764585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.764844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.765583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:20.766178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.767565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.771422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.772086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.772365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.772640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.773420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:20.773723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.775086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.778932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 534/1098] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:20.783076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 565/1099] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:20.784769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.788541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.882687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2f4ed-f90c-4c2a-ad5f-37ee389d46cb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.883473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaed262-23e8-43fe-b9eb-ebd0c5582df7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:20.915859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.916730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.917023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.917295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] PATH_INFO: `/v3/users/3bd7def91c3e47c3930738972c865831` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.917802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:20.918600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:20.918703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] RBAC: Authorizing `identity:get_user(user_id=3bd7def91c3e47c3930738972c865831)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.918883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:20.919158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:20.920056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.921735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 566/1100] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/users/3bd7def91c3e47c3930738972c865831 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:20.926440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:20.928402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:20.929170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:20.941836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 05:58:20.943022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 535/1101] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:20.948886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:21.027549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4696-2540-4b19-ac17-3fb5df058941 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:21.045016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c2da3-a200-4bd3-8ec7-54c8514d1cef None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:21.060682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:21.061352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:21.061626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:21.061892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:21.078458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:21.079233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:21.079517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:21.079791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:21.080577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:21.080885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:21.082336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:21.093518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 536/1102] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:21.099624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:21.127552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:21.129029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:21.191472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4de9a-6a37-4310-a7b1-e7eaefa65ecf None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:21.224132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:21.224982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:21.225264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:21.225539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:21.226358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] RBAC: Adding query filter params (role.id=cb6dbcfb32a1435f952b72f0e77d7220, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=07287811d9ef4e04bd62a665d642b61d) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:21.226533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 567/1103] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 04 05:58:21.226980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:21.228421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:21.232436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:21.241343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 537/1104] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:21 2022] GET /identity/v3/role_assignments?user.id=07287811d9ef4e04bd62a665d642b61d&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=cb6dbcfb32a1435f952b72f0e77d7220 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:21.345048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085f12a-ef6e-4281-a9f4-0c7029d4fe29 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:21.382066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7597df-8623-4905-bde4-acfb8053e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:21.382941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7597df-8623-4905-bde4-acfb8053e8aa None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:21.383216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7597df-8623-4905-bde4-acfb8053e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:21.383480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7597df-8623-4905-bde4-acfb8053e8aa None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:21.384729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7597df-8623-4905-bde4-acfb8053e8aa None admin] RBAC: Authorizing `identity:get_project(project_id=159a12b46c4b473383c9a187a0bf6954)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:21.386206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7597df-8623-4905-bde4-acfb8053e8aa None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:21.387918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 568/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:21 2022] GET /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:21.394644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:21.496179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f0dc8-b781-4d50-8df4-e1ba27eda694 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:21.529253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:21.529883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:21.530161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:21.530436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:21.531299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=159a12b46c4b473383c9a187a0bf6954, user.id=3bd7def91c3e47c3930738972c865831) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:21.531636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:21.533271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4375336-8cd7-447b-8a2f-8584decd3c98 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:21.539282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 538/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:21 2022] GET /identity/v3/role_assignments?user.id=3bd7def91c3e47c3930738972c865831&scope.project.id=159a12b46c4b473383c9a187a0bf6954&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:23.878285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6c20-03f7-4739-bf57-b9114609c53e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:23.879107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6c20-03f7-4739-bf57-b9114609c53e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:23.879107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6c20-03f7-4739-bf57-b9114609c53e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:23.881991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 569/1107] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:23.887422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:23.887837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:23.888026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:24.034799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:24.036001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:24.103387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 539/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:24.128383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6c20-03f7-4739-bf57-b9114609c53e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:24.246403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6c20-03f7-4739-bf57-b9114609c53e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:24.286829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dae1f9-b86b-4885-89d6-994844c08f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:24.287608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dae1f9-b86b-4885-89d6-994844c08f34 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:24.287882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dae1f9-b86b-4885-89d6-994844c08f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:24.288153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dae1f9-b86b-4885-89d6-994844c08f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:24.289462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dae1f9-b86b-4885-89d6-994844c08f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:24.290897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dae1f9-b86b-4885-89d6-994844c08f34 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:24.292487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 570/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:24.300254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:24.418605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d15485-a5d6-4ddc-9e5d-a038b922de2f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:24.455508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d006f4-86da-40fb-bd78-1c985e661469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:24.456172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d006f4-86da-40fb-bd78-1c985e661469 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:24.456445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d006f4-86da-40fb-bd78-1c985e661469 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:24.456709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d006f4-86da-40fb-bd78-1c985e661469 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:24.457475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d006f4-86da-40fb-bd78-1c985e661469 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:24.458894 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d006f4-86da-40fb-bd78-1c985e661469 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:24.482884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 540/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:58:24 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:26.772160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236d97-f3a7-4bd9-b40e-126076894dab None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:26.773086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236d97-f3a7-4bd9-b40e-126076894dab None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:26.773086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236d97-f3a7-4bd9-b40e-126076894dab None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:26.775924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 571/1111] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:26.781453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:26.781862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:26.781969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:26.800396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:26.801587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:26.870727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 541/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:26.895188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d236d97-f3a7-4bd9-b40e-126076894dab None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:26.997989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d236d97-f3a7-4bd9-b40e-126076894dab None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:27.038933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:27.040139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:27.040576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:27.040990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] PATH_INFO: `/v3/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:27.043566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] RBAC: Authorizing `identity:get_role(role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:27.045785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:27.047972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 572/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:26 2022] GET /identity/v3/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:27.056443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:27.158693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e23b-fb9e-47d8-ad8b-c2b226c2fcbf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:27.192542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:27.193425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:27.193700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:27.193962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] PATH_INFO: `/v3/users/430948dcac9a4436b19561cb11e6755e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:27.207328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=430948dcac9a4436b19561cb11e6755e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:27.208756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:27.210399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 542/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:27 2022] GET /identity/v3/users/430948dcac9a4436b19561cb11e6755e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:27.216882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:27.324572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff876cc-524a-452a-8d69-7f6488a14063 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:27.357747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:27.358367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:27.358639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:27.358905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:27.424214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:27.425666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:27.520282 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 573/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:27.526884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:27.629301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e387f-4e75-447c-b6c5-9eba2c25bdb6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:27.663201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b70a5f-c646-4cab-b67f-565a2c8c9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:27.664047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70a5f-c646-4cab-b67f-565a2c8c9c1a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:27.664319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70a5f-c646-4cab-b67f-565a2c8c9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:27.664586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b70a5f-c646-4cab-b67f-565a2c8c9c1a None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:27.665914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70a5f-c646-4cab-b67f-565a2c8c9c1a None admin] RBAC: Authorizing `identity:get_project(project_id=159a12b46c4b473383c9a187a0bf6954)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:27.667330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b70a5f-c646-4cab-b67f-565a2c8c9c1a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:27.668996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 543/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:27 2022] GET /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:27.675372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:27.779889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03c64-81ae-4b1e-96fb-ff49ea95089c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:27.814126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:27.814764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:27.815042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:27.815313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:27.816135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] RBAC: Adding query filter params (role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=159a12b46c4b473383c9a187a0bf6954, user.id=430948dcac9a4436b19561cb11e6755e) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:27.816438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:27.817867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36c91d-7b8b-4569-9fd0-866914f143ee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:27.823633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 574/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:27 2022] GET /identity/v3/role_assignments?user.id=430948dcac9a4436b19561cb11e6755e&scope.project.id=159a12b46c4b473383c9a187a0bf6954&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:30.092064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4936f-1256-4269-b84e-ad39cfb36a80 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:30.092976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4936f-1256-4269-b84e-ad39cfb36a80 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:30.092976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4936f-1256-4269-b84e-ad39cfb36a80 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:30.095964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 544/1118] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:30.104623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:30.105055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:30.105271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:30.124296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:30.126010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:30.196661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 575/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:30.222712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4936f-1256-4269-b84e-ad39cfb36a80 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:30.338886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4936f-1256-4269-b84e-ad39cfb36a80 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:30.376456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:30.377824 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:30.378300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:30.378781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] PATH_INFO: `/v3/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:30.380723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] RBAC: Authorizing `identity:get_role(role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:30.382490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:30.384203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 545/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:30 2022] GET /identity/v3/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:30.394261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:30.492008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c2cd-7d44-4d9b-9551-c1a43e19f297 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:30.526464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:30.527317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:30.527590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:30.527852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] PATH_INFO: `/v3/users/430948dcac9a4436b19561cb11e6755e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:30.529165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] RBAC: Authorizing `identity:get_user(user_id=430948dcac9a4436b19561cb11e6755e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:30.530610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:30.532260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 576/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:30 2022] GET /identity/v3/users/430948dcac9a4436b19561cb11e6755e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:30.538420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:30.646239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0120c5-6dd4-43de-9b71-ccc29806b3de None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:30.683803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539f89-71d0-40f9-9dd5-455c01414a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:30.684654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539f89-71d0-40f9-9dd5-455c01414a15 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:30.684926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539f89-71d0-40f9-9dd5-455c01414a15 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:30.685220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539f89-71d0-40f9-9dd5-455c01414a15 None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:30.686516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539f89-71d0-40f9-9dd5-455c01414a15 None admin] RBAC: Authorizing `identity:get_project(project_id=159a12b46c4b473383c9a187a0bf6954)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:30.688016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539f89-71d0-40f9-9dd5-455c01414a15 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:30.689706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 546/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:30 2022] GET /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:30.696723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:30.812744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da03ca-79fd-4092-8de0-47f7bd515a8d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:30.849081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53970-f8fc-4ab2-99f7-250a27d1aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:30.850445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53970-f8fc-4ab2-99f7-250a27d1aac8 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:30.850802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53970-f8fc-4ab2-99f7-250a27d1aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:30.851160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53970-f8fc-4ab2-99f7-250a27d1aac8 None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954/users/430948dcac9a4436b19561cb11e6755e/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:30.855301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53970-f8fc-4ab2-99f7-250a27d1aac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=159a12b46c4b473383c9a187a0bf6954, user_id=430948dcac9a4436b19561cb11e6755e, role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:30.857614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53970-f8fc-4ab2-99f7-250a27d1aac8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:30.872752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 577/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:58:30 2022] PUT /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954/users/430948dcac9a4436b19561cb11e6755e/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:58:33.229645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f59b8-9614-415e-9dc2-1322a80428b2 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:33.230248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f59b8-9614-415e-9dc2-1322a80428b2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:33.230248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f59b8-9614-415e-9dc2-1322a80428b2 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:33.232449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 547/1124] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:33.239029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:33.239674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:33.239674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:33.259272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:33.260704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:33.339866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 578/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:33.365935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f59b8-9614-415e-9dc2-1322a80428b2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:33.500401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f59b8-9614-415e-9dc2-1322a80428b2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:33.538874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:33.539735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:33.540004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:33.540267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] PATH_INFO: `/v3/roles/6b5fd7d8e536437d834e2cf89672a06b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:33.541803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] RBAC: Authorizing `identity:get_role(role_id=6b5fd7d8e536437d834e2cf89672a06b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:33.543616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:33.545513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 548/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:33 2022] GET /identity/v3/roles/6b5fd7d8e536437d834e2cf89672a06b => generated 223 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:33.554288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:33.676097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca3d1-2ab7-4f05-8af6-2dbd35ffc547 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:33.710046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:33.710921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:33.711202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:33.711474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] PATH_INFO: `/v3/users/430948dcac9a4436b19561cb11e6755e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:33.712665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] RBAC: Authorizing `identity:get_user(user_id=430948dcac9a4436b19561cb11e6755e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:33.714135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:33.715754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 579/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:33 2022] GET /identity/v3/users/430948dcac9a4436b19561cb11e6755e => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:33.722182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:33.835462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f11a59-43d7-416f-85c5-a560f38757ca None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:33.870278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:33.870927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:33.871202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:33.871475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:33.941043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:33.942483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:34.042131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 549/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:34.048468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:34.175971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01b950-1d12-4ece-9898-5b0027603de5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:34.210685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84233f-8ff1-4490-ae06-dbc62e09ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:34.211538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84233f-8ff1-4490-ae06-dbc62e09ef92 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:34.211812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84233f-8ff1-4490-ae06-dbc62e09ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:34.212084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84233f-8ff1-4490-ae06-dbc62e09ef92 None admin] PATH_INFO: `/v3/projects/159a12b46c4b473383c9a187a0bf6954` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:34.213413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84233f-8ff1-4490-ae06-dbc62e09ef92 None admin] RBAC: Authorizing `identity:get_project(project_id=159a12b46c4b473383c9a187a0bf6954)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:34.214842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84233f-8ff1-4490-ae06-dbc62e09ef92 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:34.216523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 580/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:34 2022] GET /identity/v3/projects/159a12b46c4b473383c9a187a0bf6954 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:34.223225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:34.320757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceef7a3-b747-464e-8161-43ef3c4e2872 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:34.358622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:34.359325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:34.359584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:34.359830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:34.360653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] RBAC: Adding query filter params (role.id=6b5fd7d8e536437d834e2cf89672a06b, scope.project.id=159a12b46c4b473383c9a187a0bf6954, user.id=430948dcac9a4436b19561cb11e6755e) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:34.360987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:34.362417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670eb51-d901-4745-bcb2-96572b9f9806 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:34.368837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 550/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:34 2022] GET /identity/v3/role_assignments?user.id=430948dcac9a4436b19561cb11e6755e&scope.project.id=159a12b46c4b473383c9a187a0bf6954&role.id=6b5fd7d8e536437d834e2cf89672a06b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:36.687531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064ba3-d179-40c5-8a49-1693e52af423 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:36.688389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064ba3-d179-40c5-8a49-1693e52af423 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:36.688599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc064ba3-d179-40c5-8a49-1693e52af423 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:36.691565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 581/1131] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:36.698080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:36.698784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:36.698929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:36.724502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:36.725716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:36.800092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 551/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:36.824360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc064ba3-d179-40c5-8a49-1693e52af423 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:36.930469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc064ba3-d179-40c5-8a49-1693e52af423 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:36.965162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577446-06a0-4c85-b626-3f4a1ab32676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:36.965883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577446-06a0-4c85-b626-3f4a1ab32676 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:36.966156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577446-06a0-4c85-b626-3f4a1ab32676 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:36.966422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577446-06a0-4c85-b626-3f4a1ab32676 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:36.967621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577446-06a0-4c85-b626-3f4a1ab32676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:36.969435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577446-06a0-4c85-b626-3f4a1ab32676 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:36.971044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 582/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:36.977407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:37.086246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f120b-a753-4e3a-a636-fbcd67c5b4f2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:37.127272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be326105-817f-4e8e-94cf-ad24b6883e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:37.127947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be326105-817f-4e8e-94cf-ad24b6883e2a None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:37.128219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be326105-817f-4e8e-94cf-ad24b6883e2a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:37.128484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be326105-817f-4e8e-94cf-ad24b6883e2a None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:37.129218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be326105-817f-4e8e-94cf-ad24b6883e2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:37.130638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be326105-817f-4e8e-94cf-ad24b6883e2a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:37.162950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 552/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:58:36 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:39.446798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be0673-80ce-4562-9437-b7b0e66ccf3d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:39.447377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be0673-80ce-4562-9437-b7b0e66ccf3d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:39.447377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be0673-80ce-4562-9437-b7b0e66ccf3d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:39.449118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 583/1135] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:39.455737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:39.456495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:39.456625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:39.479747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:39.480946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:39.554682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 553/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:39.583327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be0673-80ce-4562-9437-b7b0e66ccf3d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:39.688890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be0673-80ce-4562-9437-b7b0e66ccf3d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:39.727083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889b84-bd50-47f7-bd5c-023540137d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:39.727808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889b84-bd50-47f7-bd5c-023540137d88 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:39.728081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889b84-bd50-47f7-bd5c-023540137d88 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:39.728347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889b84-bd50-47f7-bd5c-023540137d88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:39.729620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1889b84-bd50-47f7-bd5c-023540137d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:39.731058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1889b84-bd50-47f7-bd5c-023540137d88 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:39.732638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 584/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 05:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:39.739337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:39.853924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26b65b-2624-4fe9-95f0-4f25a567bef1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:39.887780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de55d9-6761-40d5-b0e4-ff48c95b2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:39.888442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de55d9-6761-40d5-b0e4-ff48c95b2319 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:39.888720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de55d9-6761-40d5-b0e4-ff48c95b2319 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:39.889023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de55d9-6761-40d5-b0e4-ff48c95b2319 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:39.889735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de55d9-6761-40d5-b0e4-ff48c95b2319 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:39.891271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de55d9-6761-40d5-b0e4-ff48c95b2319 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:39.915365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 554/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:58:39 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:42.249026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfcfbf-e62f-467c-949b-3ebe5e057504 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:42.249771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfcfbf-e62f-467c-949b-3ebe5e057504 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:42.249771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfcfbf-e62f-467c-949b-3ebe5e057504 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:42.251475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 585/1139] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:42.258004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:42.258679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:42.258848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:42.283014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:42.284969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:42.358799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 555/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:42.395555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfcfbf-e62f-467c-949b-3ebe5e057504 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:42.502529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfcfbf-e62f-467c-949b-3ebe5e057504 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:42.538859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:42.539648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:42.539921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:42.540189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:42.550711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:42.557596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:58:42.558760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 586/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:42.565298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:42.666405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15396-bbbd-4e07-9eed-957e4615f4f4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:42.699966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:42.700641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:42.700936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:42.701217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:42.701994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:42.702353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:42.703771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:42.711776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 556/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:42.720212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:42.825405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9041b-d9ea-4e2e-a759-7f88f3dfb9c4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:42.860462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:42.861365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:42.861642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:42.861910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] PATH_INFO: `/v3/users/5cb1967cbfe74b83b4483b198945711e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:42.875393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] RBAC: Authorizing `identity:get_user(user_id=5cb1967cbfe74b83b4483b198945711e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:42.876860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:42.878510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 587/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:42 2022] GET /identity/v3/users/5cb1967cbfe74b83b4483b198945711e => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:42.884668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:42.994747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d4d0-6e02-4cb9-b3fe-3629af62c985 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:43.028433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:43.029107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:43.029387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:43.029659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:43.113040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:43.114663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:43.214108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 557/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:43.223689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:43.336934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90c15-55db-4307-b3cb-f5846f2ded70 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:43.373862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7cfe4-a71c-4c6c-b482-a53d95acff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:43.375344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7cfe4-a71c-4c6c-b482-a53d95acff51 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:43.375621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7cfe4-a71c-4c6c-b482-a53d95acff51 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:43.375889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7cfe4-a71c-4c6c-b482-a53d95acff51 None admin] PATH_INFO: `/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:43.377269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7cfe4-a71c-4c6c-b482-a53d95acff51 None admin] RBAC: Authorizing `identity:get_project(project_id=226cd1ce9e254fd1a6c3a8789676d1fd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:43.378721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7cfe4-a71c-4c6c-b482-a53d95acff51 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:43.380388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 588/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:43 2022] GET /identity/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 05:58:43.390430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:43.500763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a352e1-c46e-41a9-bdd4-1ae6220d17dc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:43.535038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:43.535673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:43.535947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:43.536213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:43.537063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=226cd1ce9e254fd1a6c3a8789676d1fd, user.id=5cb1967cbfe74b83b4483b198945711e) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:43.537355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:43.538776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d06d0-4850-4739-a2ef-72494e994f9f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:43.544226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 558/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:43 2022] GET /identity/v3/role_assignments?user.id=5cb1967cbfe74b83b4483b198945711e&scope.project.id=226cd1ce9e254fd1a6c3a8789676d1fd&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:45.804798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258d1c8-672b-4c78-905b-7c0e793679eb None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:45.805389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258d1c8-672b-4c78-905b-7c0e793679eb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:45.805389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258d1c8-672b-4c78-905b-7c0e793679eb None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:45.807150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 589/1147] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:45.814045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:45.814806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:45.814951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:45.837698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:45.838907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:45.908045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 559/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:45.936457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258d1c8-672b-4c78-905b-7c0e793679eb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:46.048645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258d1c8-672b-4c78-905b-7c0e793679eb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:46.082016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:46.082794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:46.083068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:46.083329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:46.094737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:46.101538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:58:46.102704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 590/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:46.111304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:46.213949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c60ac-3465-4505-8c72-5c00cfb39451 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:46.248395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:46.249144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:46.249422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:46.249689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:46.250429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:46.250735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:46.252094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:46.260817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 560/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:46.270314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:46.369819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cac34-9d44-468a-a410-e51e7bdfc3cd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:46.403825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:46.404684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:46.404951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:46.405396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] PATH_INFO: `/v3/users/5cb1967cbfe74b83b4483b198945711e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:46.406695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] RBAC: Authorizing `identity:get_user(user_id=5cb1967cbfe74b83b4483b198945711e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:46.408394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:46.410019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 591/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:46 2022] GET /identity/v3/users/5cb1967cbfe74b83b4483b198945711e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:46.416844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:46.522296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36cef-07ba-47ca-bf4a-2f4dd7622ae6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:46.556100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd765021-04ee-47a0-89c4-658804aa664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:46.556950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765021-04ee-47a0-89c4-658804aa664d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:46.557257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765021-04ee-47a0-89c4-658804aa664d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:46.557527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd765021-04ee-47a0-89c4-658804aa664d None admin] PATH_INFO: `/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:46.558819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd765021-04ee-47a0-89c4-658804aa664d None admin] RBAC: Authorizing `identity:get_project(project_id=226cd1ce9e254fd1a6c3a8789676d1fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:46.560248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd765021-04ee-47a0-89c4-658804aa664d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:46.562142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 561/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:46 2022] GET /identity/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:46.568479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:46.677388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3688-10f7-49c8-bd84-d8f185e8c83c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:46.712815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ff1b5-d2ca-431d-9b6c-994fb3a941b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:46.713729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff1b5-d2ca-431d-9b6c-994fb3a941b4 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:46.714007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff1b5-d2ca-431d-9b6c-994fb3a941b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:46.714278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff1b5-d2ca-431d-9b6c-994fb3a941b4 None admin] PATH_INFO: `/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd/users/5cb1967cbfe74b83b4483b198945711e/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:46.716244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff1b5-d2ca-431d-9b6c-994fb3a941b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=226cd1ce9e254fd1a6c3a8789676d1fd, user_id=5cb1967cbfe74b83b4483b198945711e, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:46.717750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff1b5-d2ca-431d-9b6c-994fb3a941b4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:46.739132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 592/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:58:46 2022] PUT /identity/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd/users/5cb1967cbfe74b83b4483b198945711e/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:58:49.009211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df5aa2-83d9-4e09-a47e-c62a9ca78e82 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:49.010130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df5aa2-83d9-4e09-a47e-c62a9ca78e82 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:49.010130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df5aa2-83d9-4e09-a47e-c62a9ca78e82 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:49.012954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 562/1154] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:49.018510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:49.018953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:49.019416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:49.037561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:49.038738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:49.113326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 593/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 05:58:49.137504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df5aa2-83d9-4e09-a47e-c62a9ca78e82 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:49.248021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df5aa2-83d9-4e09-a47e-c62a9ca78e82 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:49.281931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:49.282708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:49.282979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:49.283248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:49.294150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:58:49.300848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:58:49.302033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 563/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:49.311644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:49.416026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f9477-bc91-403d-89ad-4fe94d56593f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:49.451956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:49.452692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:49.452999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:49.453278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:49.454028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:49.454329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:49.455689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:49.463675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 594/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:49.470459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:49.579940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299fc5-062f-4068-840e-938897cc5062 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:49.613293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:49.614137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:49.614411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:49.614677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] PATH_INFO: `/v3/users/5cb1967cbfe74b83b4483b198945711e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:49.615967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=5cb1967cbfe74b83b4483b198945711e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:49.617427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:49.618998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 564/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:58:49 2022] GET /identity/v3/users/5cb1967cbfe74b83b4483b198945711e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:49.625442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:49.736987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dac1c3-81ce-4aa9-8020-29dd40a1d8a0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:49.774339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:49.774970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:49.775250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:49.775517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:49.845302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:49.847594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:49.964360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 595/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:49.971567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:50.087411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ed58-694f-4ea6-b47a-518732e9c7f9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:50.125112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb31f5-1b60-43de-b7c0-569f9456f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:50.125960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb31f5-1b60-43de-b7c0-569f9456f6ae None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:50.126236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb31f5-1b60-43de-b7c0-569f9456f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:50.126503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb31f5-1b60-43de-b7c0-569f9456f6ae None admin] PATH_INFO: `/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:50.127679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb31f5-1b60-43de-b7c0-569f9456f6ae None admin] RBAC: Authorizing `identity:get_project(project_id=226cd1ce9e254fd1a6c3a8789676d1fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:50.129145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb31f5-1b60-43de-b7c0-569f9456f6ae None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:50.130778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 565/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:58:49 2022] GET /identity/v3/projects/226cd1ce9e254fd1a6c3a8789676d1fd => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:50.137836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:50.252704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9fcf-7915-4089-81d0-095337093910 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:50.287216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:50.287857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:50.288133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:50.288387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:50.289253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=226cd1ce9e254fd1a6c3a8789676d1fd, user.id=5cb1967cbfe74b83b4483b198945711e) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:50.289552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:50.290975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b33f7-f935-4ad6-98aa-a5030342f461 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:50.297054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 596/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:58:50 2022] GET /identity/v3/role_assignments?user.id=5cb1967cbfe74b83b4483b198945711e&scope.project.id=226cd1ce9e254fd1a6c3a8789676d1fd&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:52.623885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3acc-e53b-4b3b-8a91-22de8a70b68e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:52.625105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3acc-e53b-4b3b-8a91-22de8a70b68e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:52.625105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c3acc-e53b-4b3b-8a91-22de8a70b68e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:52.627688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 566/1162] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:52.634049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:52.634786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:52.634907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:52.654282 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:52.655547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:52.724120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 597/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:52.747614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3acc-e53b-4b3b-8a91-22de8a70b68e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:52.857573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c3acc-e53b-4b3b-8a91-22de8a70b68e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:52.892161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:52.892722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:52.893028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:52.893291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:52.961689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:52.963134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:53.059249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 567/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:58:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:58:53.066024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:53.169934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dbc3b-4d0f-436e-9ebf-f9e84e9dbd9b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:53.203766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:53.204609 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:53.204954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:53.205248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:53.211868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:53.213327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:53.227416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-f056a88e-f5a1-4778-8077-5d98fd089612 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 04 05:58:53.228567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 598/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 05:58:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:58:53.238800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:53.340154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a60d-54e9-47a8-9cfe-c5a264e90215 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:53.387736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:53.388725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:53.389424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:53.390002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:53.390733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:58:53.391044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:53.392431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfdd7d-660e-435c-8bcf-5686a6c2d42e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:53.400197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 568/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Mon Apr 4 05:58:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:55.704381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6969d-d457-4d95-bb8b-1c1992b0698a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:55.705333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6969d-d457-4d95-bb8b-1c1992b0698a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:55.705333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6969d-d457-4d95-bb8b-1c1992b0698a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:55.708168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 599/1167] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:55.714450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496114-2d30-4ee5-86a3-9b18932bf271 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:55.714902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496114-2d30-4ee5-86a3-9b18932bf271 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:55.715024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496114-2d30-4ee5-86a3-9b18932bf271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:55.739697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c3496114-2d30-4ee5-86a3-9b18932bf271 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:55.740892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c3496114-2d30-4ee5-86a3-9b18932bf271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:55.823395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 569/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:55.847353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6969d-d457-4d95-bb8b-1c1992b0698a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:55.961093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6969d-d457-4d95-bb8b-1c1992b0698a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:55.995020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d6f72-99cb-4bae-85dd-179abd7a9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:55.995661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6f72-99cb-4bae-85dd-179abd7a9fed None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:55.995933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6f72-99cb-4bae-85dd-179abd7a9fed None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:55.996200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6f72-99cb-4bae-85dd-179abd7a9fed None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:55.996934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d6f72-99cb-4bae-85dd-179abd7a9fed None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:55.998312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d6f72-99cb-4bae-85dd-179abd7a9fed None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:56.019644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 600/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Mon Apr 4 05:58:55 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:58:58.330749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b608c3-11cf-48ac-8f09-07aa81dd1354 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:58.331312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b608c3-11cf-48ac-8f09-07aa81dd1354 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:58.331312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b608c3-11cf-48ac-8f09-07aa81dd1354 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:58.333128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 570/1170] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:58:58.339523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:58.340222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:58.340383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:58.361214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:58:58.362407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:58:58.430627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 601/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:58:58.456992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b608c3-11cf-48ac-8f09-07aa81dd1354 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:58.563906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b608c3-11cf-48ac-8f09-07aa81dd1354 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:58.598275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c75e54-f8db-45bf-aa89-b7000b128f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:58.599069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75e54-f8db-45bf-aa89-b7000b128f0e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:58.599344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75e54-f8db-45bf-aa89-b7000b128f0e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:58.599607 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c75e54-f8db-45bf-aa89-b7000b128f0e None admin] PATH_INFO: `/v3/domains/077481a23718400fb2061bd8d0ef1d4f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:58.610345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c75e54-f8db-45bf-aa89-b7000b128f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=077481a23718400fb2061bd8d0ef1d4f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:58.611788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c75e54-f8db-45bf-aa89-b7000b128f0e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:58.613407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 571/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Mon Apr 4 05:58:58 2022] GET /identity/v3/domains/077481a23718400fb2061bd8d0ef1d4f => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:58:58.619965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:58:58.736115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c5294-15e7-4483-88a6-96770f96dec4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:58:58.772108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04bcf4-a7ab-408b-a7e3-e397a27ffffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:58:58.772823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04bcf4-a7ab-408b-a7e3-e397a27ffffd None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:58:58.773139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04bcf4-a7ab-408b-a7e3-e397a27ffffd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:58:58.773412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04bcf4-a7ab-408b-a7e3-e397a27ffffd None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:58:58.774111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04bcf4-a7ab-408b-a7e3-e397a27ffffd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:58:58.775539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04bcf4-a7ab-408b-a7e3-e397a27ffffd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:58:58.803636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 602/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 05:58:58 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:59:01.116049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e345-320d-4689-99ce-39f662ae20b5 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:01.116913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e345-320d-4689-99ce-39f662ae20b5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:01.116913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e345-320d-4689-99ce-39f662ae20b5 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:01.119720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 572/1174] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:59:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:59:01.126087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:01.126530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:01.126621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:01.144714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:59:01.145947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:59:01.213680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 603/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:59:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:59:01.240447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e345-320d-4689-99ce-39f662ae20b5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:01.349501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e345-320d-4689-99ce-39f662ae20b5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:01.391730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f311-7764-4013-804b-f82b19b83c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:01.392977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f311-7764-4013-804b-f82b19b83c83 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:01.393422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f311-7764-4013-804b-f82b19b83c83 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:01.394225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f311-7764-4013-804b-f82b19b83c83 None admin] PATH_INFO: `/v3/domains/077481a23718400fb2061bd8d0ef1d4f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:01.396419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0f311-7764-4013-804b-f82b19b83c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=077481a23718400fb2061bd8d0ef1d4f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:01.398825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0f311-7764-4013-804b-f82b19b83c83 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:01.401555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 573/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Mon Apr 4 05:59:01 2022] GET /identity/v3/domains/077481a23718400fb2061bd8d0ef1d4f => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:01.408425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:01.516588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b468-f589-490b-9a33-abc08cb97269 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:01.550490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c06fa-2018-45ee-8161-9a3f0a609db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:01.551139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c06fa-2018-45ee-8161-9a3f0a609db9 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:01.551413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c06fa-2018-45ee-8161-9a3f0a609db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:01.551682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c06fa-2018-45ee-8161-9a3f0a609db9 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:01.552384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c06fa-2018-45ee-8161-9a3f0a609db9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:01.553829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c06fa-2018-45ee-8161-9a3f0a609db9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:01.574629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 604/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 05:59:01 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 05:59:03.894761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33aee9-48ea-42da-b905-aee151f5526a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:03.895583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33aee9-48ea-42da-b905-aee151f5526a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:03.895583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33aee9-48ea-42da-b905-aee151f5526a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:03.898550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 574/1178] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:59:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:59:03.904816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:03.905271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:03.905492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:03.929680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:59:03.930883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:59:04.005998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 605/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:59:04.030858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33aee9-48ea-42da-b905-aee151f5526a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:04.143379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33aee9-48ea-42da-b905-aee151f5526a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:04.178811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:04.179607 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:04.179890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:04.180142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:04.191141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:59:04.197957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:59:04.199108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 575/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:59:04.205471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:04.307205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461b763-a7cb-4b26-9956-3f900bed8456 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:04.342880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:04.343644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:04.343925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:04.344192 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:04.344946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:59:04.345255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:04.346618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:04.355532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 606/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:04.362447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:04.474771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca3ee-0d74-42dd-bcc3-3fef26926240 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:04.519277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:04.520144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:04.520420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:04.520687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] PATH_INFO: `/v3/users/59b8f92290904f04962343c1254afa18` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:04.533520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] RBAC: Authorizing `identity:get_user(user_id=59b8f92290904f04962343c1254afa18)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:04.535040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:04.536678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 576/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:59:04 2022] GET /identity/v3/users/59b8f92290904f04962343c1254afa18 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:04.546213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:04.651754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de8bd-e2d8-4660-b476-7c49a2834af0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:04.685002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:04.685633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:04.685916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:04.686182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:04.752571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:04.753979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:04.861197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 607/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:59:04.867393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:04.965208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b0537-0943-4085-aae8-1897f3603e06 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:05.001947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307d08-9cb3-4ae8-a168-a4932e2452f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:05.002862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307d08-9cb3-4ae8-a168-a4932e2452f2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:05.003075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307d08-9cb3-4ae8-a168-a4932e2452f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:05.003342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307d08-9cb3-4ae8-a168-a4932e2452f2 None admin] PATH_INFO: `/v3/projects/5437b9a4832b4b46be92526c2d84f415` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:05.004710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307d08-9cb3-4ae8-a168-a4932e2452f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5437b9a4832b4b46be92526c2d84f415)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:05.006216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307d08-9cb3-4ae8-a168-a4932e2452f2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:05.007990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 577/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:59:04 2022] GET /identity/v3/projects/5437b9a4832b4b46be92526c2d84f415 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:05.014344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:05.129314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31090d-871d-4c12-8cab-88e2db910bee None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:05.163596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:05.164229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:05.164500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:05.164765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:05.165608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=5437b9a4832b4b46be92526c2d84f415, user.id=59b8f92290904f04962343c1254afa18) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:59:05.165907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:05.167316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b81f-1d78-4e27-bea8-f44af61274ac None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:05.172841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 608/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:59:05 2022] GET /identity/v3/role_assignments?user.id=59b8f92290904f04962343c1254afa18&scope.project.id=5437b9a4832b4b46be92526c2d84f415&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:07.455388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314ed0-e14d-480b-b597-03d66ab13531 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:07.456240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314ed0-e14d-480b-b597-03d66ab13531 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:07.456240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314ed0-e14d-480b-b597-03d66ab13531 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:07.459109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 578/1186] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:59:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:59:07.464564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280257c-c547-4092-806c-c3267e232551 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:07.465014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280257c-c547-4092-806c-c3267e232551 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:07.465113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280257c-c547-4092-806c-c3267e232551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:07.485464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b280257c-c547-4092-806c-c3267e232551 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:59:07.486654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b280257c-c547-4092-806c-c3267e232551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:59:07.554747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 609/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:59:07.578307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314ed0-e14d-480b-b597-03d66ab13531 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:07.682745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314ed0-e14d-480b-b597-03d66ab13531 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:07.721846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:07.722970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:07.723400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:07.723805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:07.740026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:59:07.746911 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:59:07.748085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 579/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:59:07.754561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280257c-c547-4092-806c-c3267e232551 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:07.871488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280257c-c547-4092-806c-c3267e232551 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:07.907540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:07.908206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:07.908490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:07.908760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:07.909541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:59:07.909852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:07.911230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:07.919356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 610/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:07.929296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:08.030050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46b336-538d-4c3f-bfa2-1688a292498d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:08.063645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:08.064496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:08.064774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:08.065075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] PATH_INFO: `/v3/users/59b8f92290904f04962343c1254afa18` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:08.066363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] RBAC: Authorizing `identity:get_user(user_id=59b8f92290904f04962343c1254afa18)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:08.067793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:08.069426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 580/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:59:07 2022] GET /identity/v3/users/59b8f92290904f04962343c1254afa18 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:08.075388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:08.195504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d971ce-4fa0-4a5c-8f5c-198c49c92226 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:08.230683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d60db0-0e66-42f3-bb9e-06f1fea62281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:08.231563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d60db0-0e66-42f3-bb9e-06f1fea62281 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:08.231835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d60db0-0e66-42f3-bb9e-06f1fea62281 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:08.232107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d60db0-0e66-42f3-bb9e-06f1fea62281 None admin] PATH_INFO: `/v3/projects/5437b9a4832b4b46be92526c2d84f415` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:08.233433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d60db0-0e66-42f3-bb9e-06f1fea62281 None admin] RBAC: Authorizing `identity:get_project(project_id=5437b9a4832b4b46be92526c2d84f415)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:08.235181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d60db0-0e66-42f3-bb9e-06f1fea62281 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:08.236860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 611/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:59:08 2022] GET /identity/v3/projects/5437b9a4832b4b46be92526c2d84f415 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:08.246888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:08.360478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafdaf-5526-4292-bfa4-031528d57af3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:08.394925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cb49d-94e7-4f6b-8510-381c6e76301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:08.395801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb49d-94e7-4f6b-8510-381c6e76301c None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:08.396049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb49d-94e7-4f6b-8510-381c6e76301c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:08.396332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb49d-94e7-4f6b-8510-381c6e76301c None admin] PATH_INFO: `/v3/projects/5437b9a4832b4b46be92526c2d84f415/users/59b8f92290904f04962343c1254afa18/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:08.398562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cb49d-94e7-4f6b-8510-381c6e76301c None admin] RBAC: Authorizing `identity:create_grant(project_id=5437b9a4832b4b46be92526c2d84f415, user_id=59b8f92290904f04962343c1254afa18, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:08.399985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cb49d-94e7-4f6b-8510-381c6e76301c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:08.421338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 581/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 05:59:08 2022] PUT /identity/v3/projects/5437b9a4832b4b46be92526c2d84f415/users/59b8f92290904f04962343c1254afa18/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 05:59:10.694522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7547-a19e-4a97-87ee-7c9954e69108 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:10.695080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7547-a19e-4a97-87ee-7c9954e69108 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:10.695080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7547-a19e-4a97-87ee-7c9954e69108 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:10.696836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 612/1193] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 05:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 05:59:10.705716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:10.706421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:10.706514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:10.734022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 05:59:10.735211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 05:59:10.805547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 582/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 05:59:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 05:59:10.830724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe7547-a19e-4a97-87ee-7c9954e69108 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:10.942829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe7547-a19e-4a97-87ee-7c9954e69108 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:10.975995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:10.976711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:10.977097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:10.977278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:10.988182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 05:59:10.995011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 05:59:10.996165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 613/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 05:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 05:59:11.003182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:11.124764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44293b68-09b3-4fef-889e-4ea456348682 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:11.163657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:11.164318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:11.164594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:11.164859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:11.165633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:59:11.165933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:11.167307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:11.175896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 583/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 05:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:11.181937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:11.282885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182511c-bbdb-4f34-8e79-dfcf54a53aad None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:11.316460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:11.317338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:11.317625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:11.317872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] PATH_INFO: `/v3/users/59b8f92290904f04962343c1254afa18` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:11.319188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] RBAC: Authorizing `identity:get_user(user_id=59b8f92290904f04962343c1254afa18)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:11.320607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:11.322208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 614/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Mon Apr 4 05:59:11 2022] GET /identity/v3/users/59b8f92290904f04962343c1254afa18 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:11.330163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:11.431445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda42e53-0f80-44ef-b224-5a7a34ce575d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:11.464835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:11.465502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:11.465786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:11.466066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:11.532429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:11.533966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:11.630424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 584/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 05:59:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 05:59:11.636728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:11.748562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed56a5-af9d-436a-9fe2-cee7a569fcd7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:11.782533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a51aca-9e30-4019-8c89-3fcb4ea40bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:11.783382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a51aca-9e30-4019-8c89-3fcb4ea40bdc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:11.783657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a51aca-9e30-4019-8c89-3fcb4ea40bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:11.783920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a51aca-9e30-4019-8c89-3fcb4ea40bdc None admin] PATH_INFO: `/v3/projects/5437b9a4832b4b46be92526c2d84f415` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:11.785324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a51aca-9e30-4019-8c89-3fcb4ea40bdc None admin] RBAC: Authorizing `identity:get_project(project_id=5437b9a4832b4b46be92526c2d84f415)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:11.786693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a51aca-9e30-4019-8c89-3fcb4ea40bdc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:11.788349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 615/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Mon Apr 4 05:59:11 2022] GET /identity/v3/projects/5437b9a4832b4b46be92526c2d84f415 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 05:59:11.798483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 05:59:11.910483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aa6b5-a8ac-4753-baed-c8db31be00f1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 05:59:11.955943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 05:59:11.956586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 05:59:11.956862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 05:59:11.957157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 05:59:11.957982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=5437b9a4832b4b46be92526c2d84f415, user.id=59b8f92290904f04962343c1254afa18) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 05:59:11.958286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 05:59:11.959723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da81fd0-7ff1-417e-9029-e92f52c34369 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 05:59:11.965677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 585/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 05:59:11 2022] GET /identity/v3/role_assignments?user.id=59b8f92290904f04962343c1254afa18&scope.project.id=5437b9a4832b4b46be92526c2d84f415&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:13.893756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705045-06e7-4c87-a6b1-f311bb0ff21c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:13.894399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705045-06e7-4c87-a6b1-f311bb0ff21c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:13.894399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705045-06e7-4c87-a6b1-f311bb0ff21c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:13.896063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 616/1201] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:13.901620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:13.902142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:13.902664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:13.920261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:13.921655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:14.001296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 586/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:14.026655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc705045-06e7-4c87-a6b1-f311bb0ff21c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:14.146240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc705045-06e7-4c87-a6b1-f311bb0ff21c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:14.188038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:14.192071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:14.192071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:14.192071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:14.201636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:14.204454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:14.224193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:14.230662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 617/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:14.232223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:14.356194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afaf3f-7ce6-4ef7-86df-1027724170b4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:14.392149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:14.393152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:14.393451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:14.393689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:14.394415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:14.394736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:14.396090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdc744-65b5-47e0-a231-07ff8fc3e436 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:14.408846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 587/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:14.414194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:14.541952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f9022-c2dc-446e-a303-0662ae65cfd4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:14.580588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c32c-a30e-49bf-a001-b1036ae84d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:14.581305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c32c-a30e-49bf-a001-b1036ae84d91 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:14.581624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c32c-a30e-49bf-a001-b1036ae84d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:14.581898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c32c-a30e-49bf-a001-b1036ae84d91 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:14.582716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c32c-a30e-49bf-a001-b1036ae84d91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:14.584335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c32c-a30e-49bf-a001-b1036ae84d91 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:14.607113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 618/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Mon Apr 4 06:00:14 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:00:17.101464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4f48-03ba-43f8-b693-fc0dec61cd3e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:17.101984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4f48-03ba-43f8-b693-fc0dec61cd3e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:17.101984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4f48-03ba-43f8-b693-fc0dec61cd3e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:17.104271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 588/1206] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:17.110044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:17.110568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:17.110568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:17.129329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:17.130764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:17.208428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 619/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:17.233542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4f48-03ba-43f8-b693-fc0dec61cd3e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:17.353239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4f48-03ba-43f8-b693-fc0dec61cd3e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:17.392152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:17.392977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:17.393270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:17.393530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:17.405129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 06:00:17.412155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 06:00:17.413444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 589/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 06:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:17.419830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:17.532548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42eb3-b68a-4286-9610-04585cda16b3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:17.575634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:17.576277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:17.576625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:17.576877 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:17.577667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:17.577971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:17.579402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:17.588414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 620/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 06:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:00:17.595193 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:17.714282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6999b5-5bf5-4bd6-ad49-2c22a5a1e3db None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:17.750252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:17.751063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:17.751343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:17.751616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:17.763513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:17.765136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:17.783810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:17.785131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 590/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 06:00:17.790918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:17.901350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563e75-2497-42b8-ade7-5cb6841cbd85 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:17.940099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:17.940797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:17.943573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:17.943573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:17.943573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:17.943573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:17.943892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:17.956029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 621/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:17.961739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:18.079692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeed77-8bb1-4512-8481-82d36eb4c2bf None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:18.117038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:18.117870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:18.118147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:18.118423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:18.126748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:18.128209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:18.144196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 04 06:00:18.145785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 591/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:18.151391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:18.258017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6a2b-63ba-46e2-94c8-330c6c3b9fa3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:18.293624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:18.294307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:18.294591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:18.294861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:18.295701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:18.296008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:18.297469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:18.314826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 622/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Mon Apr 4 06:00:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:18.320598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:18.430227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4f8b4-506a-427b-8d57-35abf11e1e38 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:18.466565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:18.467301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:18.467606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:18.467881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:18.544867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:18.546697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:18.647675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 592/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 06:00:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 06:00:18.653580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:18.755410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543a92-de7d-4f0e-bce6-c0788c9469ab None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:18.792116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:18.793665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:18.794148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:18.794435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:18.807745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:18.807745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:18.826870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:18.828575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 623/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:18.834420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:18.953791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235afd8-f067-4239-affb-88be022db0f3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:18.993492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:18.994239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:18.994449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:18.994740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:18.995787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:18.996304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:18.997896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:19.015852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 593/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:19.018524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:19.126244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942be3e5-6a88-44ff-b31a-bc31ba2eb9ce None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:19.160712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:19.162381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:19.162869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:19.163326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:19.170843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:19.172546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:19.186585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 06:00:19.193127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 624/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 06:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:19.194084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:19.316788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf0a5-8918-4c23-95bc-6a6c801debf6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:19.355427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:19.356093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:19.356374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:19.356649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:19.357483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:19.357792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:19.359386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75271b-b7d6-4e39-af7e-0fec215e8b87 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:19.376960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 594/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 06:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:00:19.383560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:19.498849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f10f1-57ae-4961-97b9-b086a4300599 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:19.539853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:19.540532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:19.540809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:19.541122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:19.541954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2dda594dc09349198b35cff3bc47c0a9) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:19.542266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:19.543780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7147bf-e12e-4fb0-8db3-500ab4b8dcb1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:19.549955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 625/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 06:00:19 2022] GET /identity/v3/role_assignments?user.id=2dda594dc09349198b35cff3bc47c0a9&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:21.838056 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002a23-b8c7-48e2-bf2e-9f24cd6f91b8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:21.838655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002a23-b8c7-48e2-bf2e-9f24cd6f91b8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:21.838655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002a23-b8c7-48e2-bf2e-9f24cd6f91b8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:21.840559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 595/1220] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 06:00:21.846040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:21.846485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:21.846584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:21.864401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:21.865656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:21.936855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 626/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:21.959628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd002a23-b8c7-48e2-bf2e-9f24cd6f91b8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:22.065349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd002a23-b8c7-48e2-bf2e-9f24cd6f91b8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:22.102318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:22.103046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:22.103324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:22.103593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:22.114616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 06:00:22.122428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 06:00:22.123751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 596/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 06:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:22.129871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:22.227243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f059d2-4833-4cb8-9a85-68b618c29793 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:22.264627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:22.265339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:22.265621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:22.265894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:22.267008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:22.267311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:22.268682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:22.277938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 627/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 06:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:22.284678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:22.395459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10634ee-f588-4537-b08c-db281481b645 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:22.430177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:22.430970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:22.431241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:22.431507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:22.442226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:22.443744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:22.460390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:22.461615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 597/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 06:00:22.468326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:22.582303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbd1fb-77b4-4e4d-9e33-3715fcd16d46 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:22.617976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:22.618801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:22.619116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:22.619415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:22.620255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:22.620591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:22.622177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:22.634945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 628/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:22.642553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:22.748366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ee7f3-6c7c-4996-8628-885f6995e1ca None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:22.789702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:22.790642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:22.790922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:22.791210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:22.800395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:22.801908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:22.818942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 04 06:00:22.820404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 598/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 06:00:22.826354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:22.936240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab742-fe78-4136-900f-3a43179d518f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:22.976348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:22.977247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:22.977653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:22.978088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:22.979326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:22.979855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:22.982408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:23.005341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 629/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Mon Apr 4 06:00:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:23.012535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:23.144490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f84086-d4de-4f32-8618-2595df459660 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:23.181322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:23.182216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:23.182496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:23.182813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:23.194916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:23.196508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:23.215146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:23.216364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 599/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:23.222354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:23.335486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d79343-c9ca-4f6e-856c-573a9b3d0814 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:23.375228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:23.375893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:23.376201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:23.376536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:23.377220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:23.377522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:23.378899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:23.392919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 630/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:00:23.398930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:23.517384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e9bf-47b7-4844-bb50-f8d30bee15b7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:23.555185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:23.555991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:23.556273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:23.556550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:23.563644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:23.565190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:23.579132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 06:00:23.580318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 600/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 06:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:23.586403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:23.696568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6ef6c-0d3d-4889-8da4-096c73dc9a21 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:23.730977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:23.731648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:23.731928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:23.732195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:23.733026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:23.733320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:23.734758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067be4b3-ae9f-49db-8ed7-0774780bfc0e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:23.748256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 631/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 06:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:23.755560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:23.866923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c8dd-0b5c-4d5b-86da-3cf33933dce6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:23.908792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e2992-3e04-4bca-95e8-ff1746040eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:23.909852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2992-3e04-4bca-95e8-ff1746040eaa None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:23.910265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2992-3e04-4bca-95e8-ff1746040eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:23.910571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2992-3e04-4bca-95e8-ff1746040eaa None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2dda594dc09349198b35cff3bc47c0a9/roles/7ab4269b74294580b9a752a710c05a9c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:23.927968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e2992-3e04-4bca-95e8-ff1746040eaa None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=2dda594dc09349198b35cff3bc47c0a9, role_id=7ab4269b74294580b9a752a710c05a9c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:23.929615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e2992-3e04-4bca-95e8-ff1746040eaa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:23.942556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 601/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 06:00:23 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2dda594dc09349198b35cff3bc47c0a9/roles/7ab4269b74294580b9a752a710c05a9c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:00:26.677871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc0c95-39ec-4576-9157-8bfdb17e52a5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:26.678447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc0c95-39ec-4576-9157-8bfdb17e52a5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:26.678447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc0c95-39ec-4576-9157-8bfdb17e52a5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:26.680205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 632/1233] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:26.685959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:26.686480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:26.686480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:26.706986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:26.708585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:26.783414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 602/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:26.814265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc0c95-39ec-4576-9157-8bfdb17e52a5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:26.949005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc0c95-39ec-4576-9157-8bfdb17e52a5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:26.984423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:26.985252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:26.985566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:26.986111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:26.999345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 06:00:27.007896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 04 06:00:27.009506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 633/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Mon Apr 4 06:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:27.016321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:27.120807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e457-381e-4219-9b6d-92348166830d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:27.159510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:27.160213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:27.160652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:27.161001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:27.161768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:27.162060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:27.163534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:27.173794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 603/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Mon Apr 4 06:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:27.180228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:27.289303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67c53-616b-4f2e-9c0a-9a96738152bb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:27.325458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:27.326290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:27.326603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:27.326943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:27.338475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:27.340214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:27.356893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:27.358142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 634/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 04 06:00:27.363961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:27.476008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1af2a3-6bc7-4daf-9427-447adc26a193 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:27.511870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:27.512597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:27.512930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:27.513252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:27.514079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:27.514438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:27.516360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:27.529334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 604/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:27.536552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:27.648822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a015087-4b5d-42ad-9cfc-19992670d400 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:27.686195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:27.687010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:27.687295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:27.687572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:27.695985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:27.697439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:27.711099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 04 06:00:27.712300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 635/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:27.718750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:27.828991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e380-5dba-450f-be72-660b3dec6f10 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:27.871544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:27.872376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:27.872739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:27.873121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:27.874061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:27.874377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:27.876147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:27.897142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 605/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Mon Apr 4 06:00:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:27.904816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:28.012138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3ee3e-8d6e-452d-afa3-9c8dfcfebce8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:28.046975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:28.047626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:28.047901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:28.048176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:28.115288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:28.116948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:28.229019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 636/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 06:00:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 06:00:28.235616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:28.346339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fe6d4-96b8-4d1f-b71f-5806be808244 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:28.384517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:28.385470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:28.385832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:28.386267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:28.397597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:28.399223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:28.418039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:28.419514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 606/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:28.425496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:28.531911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a86fc-4170-4cb1-9281-825dfd1902ce None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:28.573543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:28.574505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:28.574873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:28.575210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:28.576234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:28.576604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:28.578076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:28.591691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 637/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:28.597156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:28.703892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fa1a-4fbc-4454-a338-ca7aa06b6ef3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:28.742816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:28.743935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:28.744352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:28.744704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:28.755328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:28.757317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:28.772462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 06:00:28.773703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 607/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 06:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:28.779670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:28.888276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c985a-0751-4c57-af3b-a3b3cbd1778a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:28.925868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:28.926664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:28.926930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:28.927245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:28.928080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:28.928423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:28.930000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404135-a042-4356-b8e2-e17c7b670b08 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:28.944532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 638/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 06:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:28.951314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:29.062927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df912ef2-f43c-4762-b286-15c2eb101042 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:29.099826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:29.100412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:29.100749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:29.100998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:29.101833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] RBAC: Adding query filter params (role.id=7ab4269b74294580b9a752a710c05a9c, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2dda594dc09349198b35cff3bc47c0a9) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:29.102135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:29.103571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263c363-6966-48f8-bc72-f01acd8b6a4b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:29.109397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 608/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 06:00:28 2022] GET /identity/v3/role_assignments?user.id=2dda594dc09349198b35cff3bc47c0a9&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=7ab4269b74294580b9a752a710c05a9c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:31.563107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6032e1-0865-49ce-ba7d-fc211f151de5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:31.563735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6032e1-0865-49ce-ba7d-fc211f151de5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:31.563735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6032e1-0865-49ce-ba7d-fc211f151de5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:31.565501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 639/1247] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:31.571327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:31.571771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:31.571907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:31.590007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:31.591204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:31.660651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 609/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 04 06:00:31.686048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6032e1-0865-49ce-ba7d-fc211f151de5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:31.791203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6032e1-0865-49ce-ba7d-fc211f151de5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:31.826742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:31.828172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:31.828614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:31.829068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:31.843125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 06:00:31.851915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 06:00:31.853857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 640/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 06:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:31.860986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:31.979963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a33252-925c-4b81-9f2d-d430a9054cda None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:32.018345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:32.019066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:32.019349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:32.019686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:32.020504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:32.020855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:32.022396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:32.031681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 610/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 06:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:32.037837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:32.140110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970864d-5d72-4579-aa44-715ef60450cf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:32.178480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:32.179396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:32.179709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:32.180009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:32.192073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:32.193581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:32.212084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:32.213417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 641/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:32.220142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:32.325806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105ed4-08fa-41e3-bb3f-417f33fdf04d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:32.361007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:32.361647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:32.361955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:32.362197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:32.362915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:32.363215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:32.364596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:32.377895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 611/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:32.383620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:32.491121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c033ff-56ed-4a78-87a4-70e59b7032d5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:32.527942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:32.529189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:32.529594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:32.529867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] PATH_INFO: `/v3/users/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:32.541731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:32.543706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:32.558808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 04 06:00:32.560158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 642/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:32.566743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:32.677694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b872d81-f93c-4221-aafd-09ebd88fc5df None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:32.719706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:32.720419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:32.720702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:32.721058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:32.721960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:32.722280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:32.723786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:32.742828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 612/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Mon Apr 4 06:00:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:32.748402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:32.862096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e8be4-d536-417b-a3e5-1d5a0d81befe None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:32.902704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:32.903361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:32.903636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:32.903906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:32.975321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:32.976871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:33.092266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 643/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 06:00:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 06:00:33.098609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:33.207306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3da8a-8bb7-44b9-86cd-69023501e67a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:33.243587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:33.244187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:33.244462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:33.244730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:33.256949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:33.258433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:33.276940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:33.278193 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 613/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:33.284086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:33.384503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a1d5-d898-46bf-88d0-8f5e43505436 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:33.417645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:33.418306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:33.418584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:33.418851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:33.419587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:33.419878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:33.421266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:33.432868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 644/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:00:33.438595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:33.538860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68394f-63a3-4944-8a62-05c19720008a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:33.572457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:33.573460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:33.573861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:33.574305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:33.581064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:33.582526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:33.595491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 06:00:33.596672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 614/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 06:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:33.602837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:33.704684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b39e4-792b-4a0b-8923-c5bcde2804b7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:33.744080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:33.744732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:33.745292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:33.745627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:33.746421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:33.746729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:33.748170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af2f22-17d8-40c2-9305-41841b4bbf83 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:33.760155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 645/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 06:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:33.767014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:33.876053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89735b33-9764-492d-b6c4-a9fb1316f781 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:33.909263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:33.909902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:33.910173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:33.910439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:33.911260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2dda594dc09349198b35cff3bc47c0a9) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:33.911565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:33.913025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0182d1-cd8f-4fb9-96f5-2ad27a77dc55 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:33.918606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 615/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 06:00:33 2022] GET /identity/v3/role_assignments?user.id=2dda594dc09349198b35cff3bc47c0a9&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=5fd8ee302a3344489bda8c045d41beba => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:36.241495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edcc63-3cc4-42d3-9e99-7ff0a8e0aabd None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:36.241495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edcc63-3cc4-42d3-9e99-7ff0a8e0aabd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:36.241495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edcc63-3cc4-42d3-9e99-7ff0a8e0aabd None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:36.242782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 646/1261] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:36.248309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:36.248726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:36.248843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:36.267661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:36.268853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:36.341495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 616/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:36.364657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edcc63-3cc4-42d3-9e99-7ff0a8e0aabd None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:36.471321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edcc63-3cc4-42d3-9e99-7ff0a8e0aabd None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:36.504651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:36.505394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:36.505664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:36.505931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:36.516524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 06:00:36.523326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 06:00:36.524445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 647/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 06:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:36.530944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:36.629384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f59397-4692-4eef-812d-880b23e69bd8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:36.663165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:36.663817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:36.664086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:36.664352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:36.665115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:36.665418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:36.666830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:36.675799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 617/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 06:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:36.681887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:36.780647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae280e86-61bd-42d8-a8f3-046622054999 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:36.821908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:36.822918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:36.823216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:36.823517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:36.836352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:36.837847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:36.856311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:36.857578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 648/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:36.864013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:36.968268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286fdd8-dbd9-4579-b010-12b6d4a68a25 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:37.001599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:37.002250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:37.002523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:37.002792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:37.003507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:37.003808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:37.005192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:37.017132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 618/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:37.025565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:37.130258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7ca5f-d0df-472d-a338-473b02f9e829 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:37.163722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:37.164506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:37.164779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:37.165077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:37.172617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:37.174090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:37.187517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 04 06:00:37.188639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 649/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:37.197361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:37.308331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e06a-fd8f-4574-8541-da6b93b3292c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:37.343806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:37.344457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:37.344739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:37.345026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:37.345858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:37.346157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:37.347574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:37.364473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 619/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Mon Apr 4 06:00:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:37.370466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:37.474813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04774ca2-4fbe-43a6-be44-3507ee0ffc16 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:37.509568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:37.510434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:37.510709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:37.510979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:37.521808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:37.523253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:37.539736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:37.540962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 650/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:37.547134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:37.645760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44593062-8221-4c84-bbe9-c791bdb991f7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:37.679513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:37.680157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:37.680434 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:37.680708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:37.681464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:37.681770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:37.683185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:37.694976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 620/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:37.702278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:37.805555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a074-4d10-4a5e-a93e-00840d4a7179 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:37.842523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:37.843500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:37.843932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:37.844248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:37.852147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:37.853690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:37.869139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 06:00:37.871066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 651/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 06:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:37.877267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:37.981505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8e11-aecf-4d10-af54-3609f3b83771 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:38.018015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:38.018662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:38.018937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:38.019207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:38.019982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:38.020282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:38.021740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9dba1-8cf1-423d-b42e-c2964b43ce49 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:38.035436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 621/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 06:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:38.042340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:38.158435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded158-f8eb-413d-912d-0aadf06026e4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:38.195912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038581-f21d-4742-b9f9-a9fe4f109207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:38.196790 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038581-f21d-4742-b9f9-a9fe4f109207 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:38.197093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038581-f21d-4742-b9f9-a9fe4f109207 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:38.197361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038581-f21d-4742-b9f9-a9fe4f109207 None admin] PATH_INFO: `/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2dda594dc09349198b35cff3bc47c0a9/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:38.199570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e038581-f21d-4742-b9f9-a9fe4f109207 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ba26b66ef4d278a11b80b7b2d448e, user_id=2dda594dc09349198b35cff3bc47c0a9, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:38.201033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e038581-f21d-4742-b9f9-a9fe4f109207 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:38.216263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 652/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Mon Apr 4 06:00:38 2022] PUT /identity/v3/projects/8e7ba26b66ef4d278a11b80b7b2d448e/users/2dda594dc09349198b35cff3bc47c0a9/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:00:40.500464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822f075-baa8-45b3-be2a-3bcd139a0f2e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:40.501069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822f075-baa8-45b3-be2a-3bcd139a0f2e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:40.501069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822f075-baa8-45b3-be2a-3bcd139a0f2e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:40.502856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 622/1274] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:40.509244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:40.509916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:40.510382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:40.528295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:40.529491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:40.596635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 653/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:40.620435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822f075-baa8-45b3-be2a-3bcd139a0f2e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:40.721836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822f075-baa8-45b3-be2a-3bcd139a0f2e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:40.756461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:40.757205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:40.757481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:40.757753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:40.769987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 04 06:00:40.776892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 04 06:00:40.778112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 623/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Mon Apr 4 06:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:40.784438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:40.897900 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38c9d-da01-411d-bd54-9bcc7d83b302 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:40.938171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:40.939285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:40.939647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:40.940113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:40.941529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:40.941777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:40.944011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:40.956251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 654/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Mon Apr 4 06:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:40.962983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:41.072581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbe6a-56ff-4226-b1f8-9200d9bcae34 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:41.110162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:41.110947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:41.111224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:41.111494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:41.122912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:41.124334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:41.141337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:41.142489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 624/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:41.151950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:41.252937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f27d7-b77a-44fb-89dd-97d8dcac9e69 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:41.287053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:41.287699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:41.287985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:41.288251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:41.288964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:41.289293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:41.290663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:41.302198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 655/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:41.308874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:41.416975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d586-e2d8-436a-83d1-5e7c6b5423da None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:41.450811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:41.451597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:41.451875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:41.452144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] PATH_INFO: `/v3/users/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:41.459736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:41.461201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:41.475102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 04 06:00:41.476243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 625/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:41.482818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:41.579805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de65c9-e90e-4236-b116-02618fdf8567 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:41.614061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:41.614716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:41.614990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:41.615262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:41.616081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:41.616411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:41.617833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:41.634778 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 656/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Mon Apr 4 06:00:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:41.641466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:41.761767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa882e-27d1-4fd2-9e97-a1138ac03ded None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:41.796935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:41.797620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:41.797898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:41.798172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:41.873017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:41.874481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:41.977844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 626/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Mon Apr 4 06:00:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 04 06:00:41.987330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:42.096423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9b16-3eb7-46c7-a823-ea79e953904f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:42.130641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:42.131416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:42.131695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:42.131964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:42.142889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:42.144332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:42.161277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 04 06:00:42.162414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 657/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:42.169152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:42.289292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcd459-2f0b-407f-8f33-f7eed4fe4ce4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:42.327775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:42.328428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:42.328705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:42.329009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:42.329731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:42.330034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:42.331417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:42.342650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 627/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Mon Apr 4 06:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:42.348997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:42.456083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73eee6-82f8-43ec-b2a9-03a5b25aae7d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:42.490178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:42.490943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:42.491216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:42.491479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:42.498862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:42.500287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:42.513724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.application [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 04 06:00:42.514839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 658/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Mon Apr 4 06:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:42.521811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:42.629347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6a29-ec8c-45fd-8485-8edb0eaa1cbd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:42.663569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:42.664184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:42.664495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:42.664764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:42.665586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:42.665889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:42.667393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50216b69-fce3-45af-ad43-a68d21f6a5a1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:42.679286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 628/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Mon Apr 4 06:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:42.686299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:42.787978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f1e9b-85ec-458a-b906-6d8b947ce303 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:42.821913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:42.822700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:42.822997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:42.823577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:42.824579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] RBAC: Adding query filter params (role.id=5fd8ee302a3344489bda8c045d41beba, scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e, user.id=2dda594dc09349198b35cff3bc47c0a9) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:42.825141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:42.826897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcd30-3b05-4655-9042-4389d56d649e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:42.834553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 659/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Mon Apr 4 06:00:42 2022] GET /identity/v3/role_assignments?user.id=2dda594dc09349198b35cff3bc47c0a9&scope.project.id=8e7ba26b66ef4d278a11b80b7b2d448e&role.id=5fd8ee302a3344489bda8c045d41beba => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:45.181176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2887434-fe7a-4c54-899c-15515ad75960 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:45.182089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2887434-fe7a-4c54-899c-15515ad75960 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:45.182089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2887434-fe7a-4c54-899c-15515ad75960 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:45.184578 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 629/1288] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:45.192581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:45.193330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:45.193522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:45.214199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:45.215392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:45.292819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 660/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:45.314859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2887434-fe7a-4c54-899c-15515ad75960 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:45.420575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2887434-fe7a-4c54-899c-15515ad75960 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:45.455552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:45.456266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:45.456537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:45.456803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:45.457480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:45.458846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:45.471052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 04 06:00:45.472209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 630/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 06:00:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:45.479346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:45.586817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03261b97-0e73-4b9c-b366-35fed3fdc461 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:45.620303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:45.621019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:45.621303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:45.621708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:45.622408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:45.622715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:45.624079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1838e79-be88-42fc-b317-100f3775ad33 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:45.628961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 661/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Mon Apr 4 06:00:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:45.638009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:45.758780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffdf22-2742-4c97-b37b-6048fa786e2b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:45.796687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:45.797511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:45.797791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:45.798057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:45.798784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] RBAC: Adding query filter params (type=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:45.799085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:45.800455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c368ed-348b-4584-a9b2-8c873fcf675f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:45.805512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 631/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Mon Apr 4 06:00:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:48.069785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220bf92-7e31-48d8-87ea-2819c178f9af None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:48.071361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220bf92-7e31-48d8-87ea-2819c178f9af None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:48.072014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220bf92-7e31-48d8-87ea-2819c178f9af None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:48.074711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 662/1293] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:48.080482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01454eb-4a2a-4f1c-9895-7a842f3b7bc0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:48.080926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01454eb-4a2a-4f1c-9895-7a842f3b7bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:48.081037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01454eb-4a2a-4f1c-9895-7a842f3b7bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:48.105582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c01454eb-4a2a-4f1c-9895-7a842f3b7bc0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:48.106700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c01454eb-4a2a-4f1c-9895-7a842f3b7bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:48.174639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 632/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:48.197662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220bf92-7e31-48d8-87ea-2819c178f9af None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:48.300828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220bf92-7e31-48d8-87ea-2819c178f9af None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:48.342752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34f51-1830-4c13-ba8c-a877bdca2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:48.343421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34f51-1830-4c13-ba8c-a877bdca2833 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:48.343693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34f51-1830-4c13-ba8c-a877bdca2833 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:48.343963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34f51-1830-4c13-ba8c-a877bdca2833 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:48.344679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c34f51-1830-4c13-ba8c-a877bdca2833 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:48.346095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c34f51-1830-4c13-ba8c-a877bdca2833 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:48.368164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 663/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Mon Apr 4 06:00:48 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:00:50.623806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce85e5-152c-4998-8c27-6a78bdc348bc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:50.624772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce85e5-152c-4998-8c27-6a78bdc348bc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:50.624772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce85e5-152c-4998-8c27-6a78bdc348bc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:50.627595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 633/1296] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:50.633890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:50.634619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:50.634757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:50.660436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:50.661660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:50.740914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 664/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:50.767163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce85e5-152c-4998-8c27-6a78bdc348bc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:50.887550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce85e5-152c-4998-8c27-6a78bdc348bc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:50.925718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:50.926516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:50.926800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:50.927068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:50.927718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:50.929129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:50.941447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 04 06:00:50.942616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 634/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 06:00:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:50.952235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:51.059583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f808d-0535-442d-8ae5-46dc6d29f701 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:51.093369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:51.094016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:51.094293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:51.094560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:51.095257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:51.095563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:51.096937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:51.102069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 665/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Mon Apr 4 06:00:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:51.109645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:51.216418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c455c-bf8c-43a8-a322-99179f8e2f48 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:51.249910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:51.250556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:51.250830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:51.251094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:51.251880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] RBAC: Adding query filter params (interface=public, service_id=bda759a92d05476bbf9228876cc10105, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:51.252186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:51.253573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62af4a-c71b-47e0-a529-c100bbc6d757 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:51.258565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 635/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Mon Apr 4 06:00:51 2022] GET /identity/v3/endpoints?service_id=bda759a92d05476bbf9228876cc10105&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:51.265061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:51.382969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50de1-b96d-492e-a2eb-d1b31f130261 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:51.421243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aabbb3-2eef-4a45-8e58-f5677e7dab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:51.421924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabbb3-2eef-4a45-8e58-f5677e7dab40 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:51.422197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabbb3-2eef-4a45-8e58-f5677e7dab40 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:51.422462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabbb3-2eef-4a45-8e58-f5677e7dab40 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:51.423136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aabbb3-2eef-4a45-8e58-f5677e7dab40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:51.424495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aabbb3-2eef-4a45-8e58-f5677e7dab40 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:51.431661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 666/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Mon Apr 4 06:00:51 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:00:53.669511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef87e-02ef-42d0-91f3-8bd68d636a5e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:53.670399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef87e-02ef-42d0-91f3-8bd68d636a5e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:53.670399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef87e-02ef-42d0-91f3-8bd68d636a5e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:53.673393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 636/1302] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:00:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:00:53.679648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:53.680350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:53.680493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:53.699983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:00:53.701214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:00:53.773882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 667/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:00:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 04 06:00:53.798037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef87e-02ef-42d0-91f3-8bd68d636a5e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:53.903674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef87e-02ef-42d0-91f3-8bd68d636a5e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:53.937293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:53.938024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:53.938300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:53.938569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] PATH_INFO: `/v3/services/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:53.939220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:53.940590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:53.951872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.application [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 04 06:00:53.953067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 637/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Mon Apr 4 06:00:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 04 06:00:53.960094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:54.073123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e664de-9a80-4aca-b58b-9b7f799c918e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:54.107498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:54.108156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:54.108435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:54.108710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:54.109447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:00:54.109755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:54.111128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e559-9dc7-4a94-9a33-3d699b9e2d6b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:54.116281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 668/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Mon Apr 4 06:00:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:00:54.125499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:00:54.228161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7c4fa-2c3d-4ff2-b22e-b245422640dc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:00:54.262101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4dbf-d717-458c-8508-3ac84c70dd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:00:54.262742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4dbf-d717-458c-8508-3ac84c70dd43 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:00:54.263016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4dbf-d717-458c-8508-3ac84c70dd43 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:00:54.263289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4dbf-d717-458c-8508-3ac84c70dd43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:00:54.264020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4dbf-d717-458c-8508-3ac84c70dd43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:00:54.265790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4dbf-d717-458c-8508-3ac84c70dd43 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:00:54.288323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 638/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Mon Apr 4 06:00:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:01:58.951835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9799-defa-453d-aef8-e2ee67696806 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:01:58.952925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9799-defa-453d-aef8-e2ee67696806 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:01:58.953416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9799-defa-453d-aef8-e2ee67696806 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:01:58.961848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9571-aa32-4d2f-9205-dc6a4937a0eb None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:01:58.962678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9571-aa32-4d2f-9205-dc6a4937a0eb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:01:58.963178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9571-aa32-4d2f-9205-dc6a4937a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:01:58.967295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 669/1307] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:01:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:01:59.037552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-525e9571-aa32-4d2f-9205-dc6a4937a0eb None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:01:59.039138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-525e9571-aa32-4d2f-9205-dc6a4937a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:01:59.168982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 639/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:01:59.252201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e2c1-2dcd-49aa-ae4d-e3315e206b69 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:01:59.252717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e2c1-2dcd-49aa-ae4d-e3315e206b69 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:01:59.253247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e2c1-2dcd-49aa-ae4d-e3315e206b69 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:01:59.255299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 670/1309] 10.222.0.30 () {54 vars in 963 bytes} [Mon Apr 4 06:01:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:01:59.266063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d40765-bf55-43f0-87b8-de19f018f1fa None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:01:59.266935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d40765-bf55-43f0-87b8-de19f018f1fa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:01:59.267746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d40765-bf55-43f0-87b8-de19f018f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:01:59.378799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-34d40765-bf55-43f0-87b8-de19f018f1fa None None] MFA Rules not processed for user `6ada2f7acb1349e38b96dfbda5546101`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:01:59.380006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-34d40765-bf55-43f0-87b8-de19f018f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:01:59.472089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 640/1310] 10.222.0.30 () {58 vars in 1060 bytes} [Mon Apr 4 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:01:59.484663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e2c1-2dcd-49aa-ae4d-e3315e206b69 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:01:59.486429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-be30e2c1-2dcd-49aa-ae4d-e3315e206b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:01:59.609484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e2c1-2dcd-49aa-ae4d-e3315e206b69 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:01:59.689018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:01:59.689719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:01:59.690002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:01:59.690268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:01:59.691964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:01:59.809907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:01:59.811387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb32d-07b1-4b0f-96d7-3ecb13ce27b1 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:01:59.832491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 671/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:02:02.400400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5f3e-8e67-4fb9-b10e-112a8bf16fdd None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:02.400966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5f3e-8e67-4fb9-b10e-112a8bf16fdd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:02.401266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5f3e-8e67-4fb9-b10e-112a8bf16fdd None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:02.403338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 641/1312] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:02.409632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617a745-d6ac-4a1a-824c-07b8982196d5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:02.410504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617a745-d6ac-4a1a-824c-07b8982196d5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:02.410773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617a745-d6ac-4a1a-824c-07b8982196d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:02.516776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3617a745-d6ac-4a1a-824c-07b8982196d5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:02.518279 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3617a745-d6ac-4a1a-824c-07b8982196d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:02.627242 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 672/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:02.666253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5f3e-8e67-4fb9-b10e-112a8bf16fdd None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:02.667951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a3bd5f3e-8e67-4fb9-b10e-112a8bf16fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:02.780746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5f3e-8e67-4fb9-b10e-112a8bf16fdd None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:02.862774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:02.864165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:02.864669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:02.865182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:02.867186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:02.980569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:02.982255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3acaad-917d-4837-836e-006c59e5b761 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:03.000982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 642/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:05.657020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db1d0-9eb1-4e03-81e0-f941e58acec5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:05.657607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db1d0-9eb1-4e03-81e0-f941e58acec5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:05.657607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db1d0-9eb1-4e03-81e0-f941e58acec5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:05.659354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 673/1315] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:05.665798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7237a-2da5-4452-96ad-911217a005c6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:05.666475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7237a-2da5-4452-96ad-911217a005c6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:05.666664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7237a-2da5-4452-96ad-911217a005c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:05.740611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b7d7237a-2da5-4452-96ad-911217a005c6 None None] MFA Rules not processed for user `664039323cb74005a11f2571bdf1b455`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:05.741862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b7d7237a-2da5-4452-96ad-911217a005c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:05.842484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 643/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:05.893385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db1d0-9eb1-4e03-81e0-f941e58acec5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:05.895827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-756db1d0-9eb1-4e03-81e0-f941e58acec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:06.026719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db1d0-9eb1-4e03-81e0-f941e58acec5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:06.100166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:06.100831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:06.101135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:06.101405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:06.103048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:06.211883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:06.213343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaefc55-fd24-4a56-919d-299070d7491a service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:06.231560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 674/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:09.087954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19851-bbbc-4bb8-8e50-9c5719b0296b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:09.088820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19851-bbbc-4bb8-8e50-9c5719b0296b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:09.088820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19851-bbbc-4bb8-8e50-9c5719b0296b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:09.092357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 644/1318] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:09.098717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1b9f-0f96-42b6-89d5-dcef541c53e4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:09.099154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1b9f-0f96-42b6-89d5-dcef541c53e4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:09.099262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1b9f-0f96-42b6-89d5-dcef541c53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:09.169870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-905b1b9f-0f96-42b6-89d5-dcef541c53e4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:09.171081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-905b1b9f-0f96-42b6-89d5-dcef541c53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:09.272022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 675/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:09.345381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756867-fd8f-4d55-bd46-6a34a9a4f3e1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:09.345701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756867-fd8f-4d55-bd46-6a34a9a4f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:09.346068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756867-fd8f-4d55-bd46-6a34a9a4f3e1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:09.348877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 645/1320] 10.222.0.30 () {54 vars in 963 bytes} [Mon Apr 4 06:02:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:09.355698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dba87a-e9bf-4050-84a0-a1ea3e5dabd3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:09.356090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dba87a-e9bf-4050-84a0-a1ea3e5dabd3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:09.356417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dba87a-e9bf-4050-84a0-a1ea3e5dabd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:09.449933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d4dba87a-e9bf-4050-84a0-a1ea3e5dabd3 None None] MFA Rules not processed for user `6ada2f7acb1349e38b96dfbda5546101`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:09.451151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d4dba87a-e9bf-4050-84a0-a1ea3e5dabd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:09.533404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 676/1321] 10.222.0.30 () {58 vars in 1060 bytes} [Mon Apr 4 06:02:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:09.547205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756867-fd8f-4d55-bd46-6a34a9a4f3e1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:09.549632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-69756867-fd8f-4d55-bd46-6a34a9a4f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:09.670216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756867-fd8f-4d55-bd46-6a34a9a4f3e1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:09.763412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:09.764070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:09.764352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:09.764619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:09.766682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:09.884687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:09.886176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4349e5-1f92-401b-8b3b-4df6ccc05315 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:09.905768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 646/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:13.311810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d373b-4ac2-4abb-949d-394b11761f10 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:13.312396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d373b-4ac2-4abb-949d-394b11761f10 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:13.312396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d373b-4ac2-4abb-949d-394b11761f10 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:13.314152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 677/1323] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:13.319501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b694-1714-49da-b703-03852d5eb07b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:13.319924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b694-1714-49da-b703-03852d5eb07b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:13.320014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b694-1714-49da-b703-03852d5eb07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:13.388244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9948b694-1714-49da-b703-03852d5eb07b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:13.389481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9948b694-1714-49da-b703-03852d5eb07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:13.487779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 647/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:13.524074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d373b-4ac2-4abb-949d-394b11761f10 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:13.525659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-811d373b-4ac2-4abb-949d-394b11761f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:13.629410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d373b-4ac2-4abb-949d-394b11761f10 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:13.702693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:13.703363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:13.703637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:13.703900 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:13.705573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:13.814032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:13.815462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cc91d-ca94-410e-9b8a-0e55d6ea733b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:13.833746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 678/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:02:16.187623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692aac-ad9a-4e5e-9e0a-cc54e55a6009 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:16.188167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692aac-ad9a-4e5e-9e0a-cc54e55a6009 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:16.188167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692aac-ad9a-4e5e-9e0a-cc54e55a6009 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:16.189955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 648/1326] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:16.195404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a16a9-a90e-4896-b2da-7c4de449a67e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:16.195809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a16a9-a90e-4896-b2da-7c4de449a67e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:16.195950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a16a9-a90e-4896-b2da-7c4de449a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:16.263662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-901a16a9-a90e-4896-b2da-7c4de449a67e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:16.264865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-901a16a9-a90e-4896-b2da-7c4de449a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:16.366623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 679/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:16.403035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692aac-ad9a-4e5e-9e0a-cc54e55a6009 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:16.404670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-98692aac-ad9a-4e5e-9e0a-cc54e55a6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:16.515667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692aac-ad9a-4e5e-9e0a-cc54e55a6009 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:16.593234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:16.593896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:16.594177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:16.594451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:16.596112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:16.706227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:16.707667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca884b-d9f1-4058-a9e9-99304c99c1d9 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:16.727045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 649/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:19.077306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287d0a-332f-4d4e-9275-a0097c08ca28 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:19.077853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287d0a-332f-4d4e-9275-a0097c08ca28 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:19.077853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287d0a-332f-4d4e-9275-a0097c08ca28 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:19.079642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 680/1329] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 06:02:19.085593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ea8d-2725-4f9f-bb7b-bc55828ae7a5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:19.086074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ea8d-2725-4f9f-bb7b-bc55828ae7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:19.086510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ea8d-2725-4f9f-bb7b-bc55828ae7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:19.156562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2f73ea8d-2725-4f9f-bb7b-bc55828ae7a5 None None] MFA Rules not processed for user `664039323cb74005a11f2571bdf1b455`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:19.157732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f73ea8d-2725-4f9f-bb7b-bc55828ae7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:19.258235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 650/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:19.295855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8287d0a-332f-4d4e-9275-a0097c08ca28 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:19.297447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d8287d0a-332f-4d4e-9275-a0097c08ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:19.401335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8287d0a-332f-4d4e-9275-a0097c08ca28 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:19.474974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:19.475543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:19.475817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:19.476081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:19.477748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:19.586648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:19.588395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134155a-e7dc-490e-becd-1fa2ba381fe2 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:19.606685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 681/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:22.125098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932585b-af01-4f49-a441-771f33500913 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:22.125595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932585b-af01-4f49-a441-771f33500913 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:22.125595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932585b-af01-4f49-a441-771f33500913 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:22.127499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 651/1332] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:22.132994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdaaaa-ecac-4811-b051-19d583084ac4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:22.133439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdaaaa-ecac-4811-b051-19d583084ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:22.133552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdaaaa-ecac-4811-b051-19d583084ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:22.201383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-60fdaaaa-ecac-4811-b051-19d583084ac4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:22.202578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-60fdaaaa-ecac-4811-b051-19d583084ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:22.297382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 682/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:22.333687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932585b-af01-4f49-a441-771f33500913 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:22.335255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d932585b-af01-4f49-a441-771f33500913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:22.445564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932585b-af01-4f49-a441-771f33500913 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:22.534989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:22.535995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:22.536275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:22.536549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:22.538277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:22.648296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:22.649695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5f564-45ce-4823-b973-d72931c96970 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:22.667921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 652/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:25.011019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5735-5589-4ccd-8642-1444db3a0c7f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:25.011598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5735-5589-4ccd-8642-1444db3a0c7f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:25.011598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5735-5589-4ccd-8642-1444db3a0c7f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:25.013459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 683/1335] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:25.020100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae2b5-e18a-4e88-9443-0cdfce7a7098 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:25.020826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae2b5-e18a-4e88-9443-0cdfce7a7098 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:25.021159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dae2b5-e18a-4e88-9443-0cdfce7a7098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:25.092664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-76dae2b5-e18a-4e88-9443-0cdfce7a7098 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:25.093954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-76dae2b5-e18a-4e88-9443-0cdfce7a7098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:25.192737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 653/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:25.231966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca5735-5589-4ccd-8642-1444db3a0c7f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:25.233528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c4ca5735-5589-4ccd-8642-1444db3a0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:25.337090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca5735-5589-4ccd-8642-1444db3a0c7f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:25.418374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:25.418980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:25.419262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:25.419529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:25.421213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:25.532472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:25.533951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b50aa-2fa6-484c-8f7e-7e32e728fd5b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:25.554169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 684/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:28.322852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908e8f-c929-42df-a711-d69099a77aee None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:28.323309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908e8f-c929-42df-a711-d69099a77aee None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:28.323414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908e8f-c929-42df-a711-d69099a77aee None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:28.325286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 654/1338] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:28.330886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc1ce-89a9-4fb8-82ee-e365803c6d24 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:28.331329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc1ce-89a9-4fb8-82ee-e365803c6d24 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:28.331425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc1ce-89a9-4fb8-82ee-e365803c6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:28.409351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-138dc1ce-89a9-4fb8-82ee-e365803c6d24 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:28.410576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-138dc1ce-89a9-4fb8-82ee-e365803c6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:28.515588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 685/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:28.552176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e908e8f-c929-42df-a711-d69099a77aee None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:28.553773 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8e908e8f-c929-42df-a711-d69099a77aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:28.682340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e908e8f-c929-42df-a711-d69099a77aee None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:28.765221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:28.766119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:28.766871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:28.767246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:28.769797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:28.905178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:28.906631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf7b02-49db-48d9-b742-9663825fd341 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:28.924694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 655/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:33.254654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52025-49db-452f-80fb-a56a19437eae None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:33.255215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52025-49db-452f-80fb-a56a19437eae None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:33.255215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b52025-49db-452f-80fb-a56a19437eae None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:33.256939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 686/1341] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:33.262248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9ab5-bdce-4d93-8928-ea9ba48e3036 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:33.262755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9ab5-bdce-4d93-8928-ea9ba48e3036 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:33.262861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9ab5-bdce-4d93-8928-ea9ba48e3036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:33.339099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0e5b9ab5-bdce-4d93-8928-ea9ba48e3036 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:33.340328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0e5b9ab5-bdce-4d93-8928-ea9ba48e3036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:33.447530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 656/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:33.486436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b52025-49db-452f-80fb-a56a19437eae None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:33.488919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-51b52025-49db-452f-80fb-a56a19437eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:33.593518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b52025-49db-452f-80fb-a56a19437eae None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:33.597135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22bfa7-08b5-4979-9826-b522c70dd0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:33.598070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22bfa7-08b5-4979-9826-b522c70dd0ff service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:33.598412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22bfa7-08b5-4979-9826-b522c70dd0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:33.598749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22bfa7-08b5-4979-9826-b522c70dd0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:33.609742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22bfa7-08b5-4979-9826-b522c70dd0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:33.611338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22bfa7-08b5-4979-9826-b522c70dd0ff service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:33.630820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 687/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:36.510171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5119-696a-4a51-87a1-10bada90d824 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:36.510699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5119-696a-4a51-87a1-10bada90d824 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:36.510699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5119-696a-4a51-87a1-10bada90d824 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:36.512611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 657/1344] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:36.518460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0b9c-9f5e-455e-88c6-321d331f2501 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:36.518846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0b9c-9f5e-455e-88c6-321d331f2501 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:36.519155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0b9c-9f5e-455e-88c6-321d331f2501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:36.548201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b1eb0b9c-9f5e-455e-88c6-321d331f2501 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:36.549431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b1eb0b9c-9f5e-455e-88c6-321d331f2501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:36.631301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 688/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:36.668421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5119-696a-4a51-87a1-10bada90d824 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:36.679862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5119-696a-4a51-87a1-10bada90d824 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:36.683679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0c27f-b647-48ba-bdb1-547facc29f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:36.684367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0c27f-b647-48ba-bdb1-547facc29f0a service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:36.684664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0c27f-b647-48ba-bdb1-547facc29f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:36.684928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0c27f-b647-48ba-bdb1-547facc29f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:36.694485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0c27f-b647-48ba-bdb1-547facc29f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:36.695918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0c27f-b647-48ba-bdb1-547facc29f0a service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:36.706007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 658/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:02:41.178804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6758c-3eb6-4f2f-9133-117d5bbc26de None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:41.179389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6758c-3eb6-4f2f-9133-117d5bbc26de None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:41.179389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6758c-3eb6-4f2f-9133-117d5bbc26de None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:41.184922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 689/1347] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:41.186619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661206ea-7a61-452c-9ec5-456a50b81890 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:41.187060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661206ea-7a61-452c-9ec5-456a50b81890 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:41.187164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661206ea-7a61-452c-9ec5-456a50b81890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:41.205464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-661206ea-7a61-452c-9ec5-456a50b81890 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:41.206684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-661206ea-7a61-452c-9ec5-456a50b81890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:41.215620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 659/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:41.253169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6758c-3eb6-4f2f-9133-117d5bbc26de None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:41.265390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6758c-3eb6-4f2f-9133-117d5bbc26de None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:41.269807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590274c-92fb-4fe1-b50c-2528fd011f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:41.270467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590274c-92fb-4fe1-b50c-2528fd011f32 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:41.270741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590274c-92fb-4fe1-b50c-2528fd011f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:41.271013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590274c-92fb-4fe1-b50c-2528fd011f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:41.280936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590274c-92fb-4fe1-b50c-2528fd011f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:41.282502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590274c-92fb-4fe1-b50c-2528fd011f32 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:41.292372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 690/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:02:46.555524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704008e-c8ad-46bc-ba14-3cbab4b39681 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:46.556092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704008e-c8ad-46bc-ba14-3cbab4b39681 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:46.556092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704008e-c8ad-46bc-ba14-3cbab4b39681 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:46.558958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 660/1350] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:02:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:46.572110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491df1bc-cdee-4c4b-afcc-148c1af38b3e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:46.572110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491df1bc-cdee-4c4b-afcc-148c1af38b3e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:46.572110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491df1bc-cdee-4c4b-afcc-148c1af38b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:46.665398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-491df1bc-cdee-4c4b-afcc-148c1af38b3e None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:46.666809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-491df1bc-cdee-4c4b-afcc-148c1af38b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:46.745132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 691/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:02:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:51.165885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee70b-2f2e-4ad3-b569-b1058d567257 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:51.166394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee70b-2f2e-4ad3-b569-b1058d567257 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:51.166595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee70b-2f2e-4ad3-b569-b1058d567257 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:51.168557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 661/1352] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:51.174144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb386-ae4a-42c2-ab63-e7d7e627f87e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:51.174592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb386-ae4a-42c2-ab63-e7d7e627f87e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:51.174810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb386-ae4a-42c2-ab63-e7d7e627f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:51.195549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-001fb386-ae4a-42c2-ab63-e7d7e627f87e None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:51.197152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-001fb386-ae4a-42c2-ab63-e7d7e627f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:51.206999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 692/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:02:52.769681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a9a5-3448-4d18-bdbf-cc6af1c6adb1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:52.770260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a9a5-3448-4d18-bdbf-cc6af1c6adb1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:52.770260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a9a5-3448-4d18-bdbf-cc6af1c6adb1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:52.772060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 662/1354] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:52.777975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03028b-74da-4543-a155-9a0c4d8c96d7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:52.778741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03028b-74da-4543-a155-9a0c4d8c96d7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:52.778741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03028b-74da-4543-a155-9a0c4d8c96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:52.798761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3b03028b-74da-4543-a155-9a0c4d8c96d7 None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:52.800123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3b03028b-74da-4543-a155-9a0c4d8c96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:52.809912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 693/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:02:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:56.752437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d377-9dd5-4ddc-9b35-0aad3f096649 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:56.753045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d377-9dd5-4ddc-9b35-0aad3f096649 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:56.753045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317d377-9dd5-4ddc-9b35-0aad3f096649 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:56.754737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 663/1356] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:56.760177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e42a73-f821-4534-8a89-fc340403701e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:56.760628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e42a73-f821-4534-8a89-fc340403701e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:56.760933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e42a73-f821-4534-8a89-fc340403701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:56.779912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-62e42a73-f821-4534-8a89-fc340403701e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:56.781259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62e42a73-f821-4534-8a89-fc340403701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:56.789374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 694/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:56.837398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e47de-bfa0-4b2d-a796-81bac61e70f8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:56.838045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e47de-bfa0-4b2d-a796-81bac61e70f8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:56.838401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e47de-bfa0-4b2d-a796-81bac61e70f8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:56.840675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 664/1358] 10.222.0.30 () {54 vars in 960 bytes} [Mon Apr 4 06:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:56.847217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180ba24-3b4c-46ed-b195-517a70bd29b0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:56.847632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180ba24-3b4c-46ed-b195-517a70bd29b0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:56.847907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180ba24-3b4c-46ed-b195-517a70bd29b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:56.897670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a180ba24-3b4c-46ed-b195-517a70bd29b0 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:56.898848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a180ba24-3b4c-46ed-b195-517a70bd29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:56.981648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 695/1359] 10.222.0.30 () {58 vars in 1057 bytes} [Mon Apr 4 06:02:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:56.990483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e47de-bfa0-4b2d-a796-81bac61e70f8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:57.005720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e47de-bfa0-4b2d-a796-81bac61e70f8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:57.011896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf040f9-7116-4cce-a350-cd0f5cc03744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:57.012893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf040f9-7116-4cce-a350-cd0f5cc03744 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:57.013321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf040f9-7116-4cce-a350-cd0f5cc03744 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:57.013732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf040f9-7116-4cce-a350-cd0f5cc03744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:57.023677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf040f9-7116-4cce-a350-cd0f5cc03744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:57.025520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf040f9-7116-4cce-a350-cd0f5cc03744 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:57.037155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 665/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:02:59.554638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d22e-5031-4fef-96f9-5699a4f1bf17 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:59.555157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d22e-5031-4fef-96f9-5699a4f1bf17 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:59.555157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d22e-5031-4fef-96f9-5699a4f1bf17 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:59.556825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 696/1361] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:02:59.562390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fb0ab-45cb-4ece-b8e7-87b25d9d9157 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:59.562831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fb0ab-45cb-4ece-b8e7-87b25d9d9157 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:59.562936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fb0ab-45cb-4ece-b8e7-87b25d9d9157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:59.581610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-470fb0ab-45cb-4ece-b8e7-87b25d9d9157 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:02:59.582969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-470fb0ab-45cb-4ece-b8e7-87b25d9d9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:02:59.591776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 666/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:02:59.635362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d22e-5031-4fef-96f9-5699a4f1bf17 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:02:59.650381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d22e-5031-4fef-96f9-5699a4f1bf17 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:02:59.656436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491426e-0fbf-433b-b41b-ac368b3758d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:02:59.657285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491426e-0fbf-433b-b41b-ac368b3758d2 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:02:59.657708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491426e-0fbf-433b-b41b-ac368b3758d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:02:59.658149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491426e-0fbf-433b-b41b-ac368b3758d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:02:59.667308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491426e-0fbf-433b-b41b-ac368b3758d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:02:59.669271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491426e-0fbf-433b-b41b-ac368b3758d2 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:02:59.679988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 697/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:02.313401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a4a5-aef0-4d46-a10f-f2efef9acf53 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:02.313945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a4a5-aef0-4d46-a10f-f2efef9acf53 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:02.313945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a4a5-aef0-4d46-a10f-f2efef9acf53 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:02.315774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 667/1364] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:02.321168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1305-a2f5-4c24-aae5-61694ac32250 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:02.321606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1305-a2f5-4c24-aae5-61694ac32250 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:02.321714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc1305-a2f5-4c24-aae5-61694ac32250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:02.342164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-31cc1305-a2f5-4c24-aae5-61694ac32250 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:02.343688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-31cc1305-a2f5-4c24-aae5-61694ac32250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:02.351960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 698/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:02.400016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083df8-dbd0-4ee6-aac3-2de269d7058b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:02.400302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083df8-dbd0-4ee6-aac3-2de269d7058b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:02.400617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083df8-dbd0-4ee6-aac3-2de269d7058b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:02.402736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 668/1366] 10.222.0.30 () {54 vars in 960 bytes} [Mon Apr 4 06:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:02.408729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6dcd9-a23f-417e-83a7-68ca21428dcb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:02.409128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6dcd9-a23f-417e-83a7-68ca21428dcb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:02.409411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6dcd9-a23f-417e-83a7-68ca21428dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:02.428414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-86a6dcd9-a23f-417e-83a7-68ca21428dcb None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:02.429794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-86a6dcd9-a23f-417e-83a7-68ca21428dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:02.440125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 699/1367] 10.222.0.30 () {58 vars in 1057 bytes} [Mon Apr 4 06:03:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:02.448022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083df8-dbd0-4ee6-aac3-2de269d7058b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:02.463700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083df8-dbd0-4ee6-aac3-2de269d7058b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:02.470022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294dbf-3ef2-4b2c-8424-e05a0a9fb110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:02.470660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294dbf-3ef2-4b2c-8424-e05a0a9fb110 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:02.471017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294dbf-3ef2-4b2c-8424-e05a0a9fb110 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:02.471788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294dbf-3ef2-4b2c-8424-e05a0a9fb110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:02.486669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294dbf-3ef2-4b2c-8424-e05a0a9fb110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:02.488283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294dbf-3ef2-4b2c-8424-e05a0a9fb110 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:02.504620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 669/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:04.867313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da7e7-fc8f-4360-aa89-21c3141a6ad0 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:04.867860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da7e7-fc8f-4360-aa89-21c3141a6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:04.867860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da7e7-fc8f-4360-aa89-21c3141a6ad0 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:04.869911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 700/1369] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:04.875382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9471-ace2-480c-8497-1a86c0f277f8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:04.875868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9471-ace2-480c-8497-1a86c0f277f8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:04.875868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9471-ace2-480c-8497-1a86c0f277f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:04.895188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-21ff9471-ace2-480c-8497-1a86c0f277f8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:04.896371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-21ff9471-ace2-480c-8497-1a86c0f277f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:04.906480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 670/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:04.952282 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158da7e7-fc8f-4360-aa89-21c3141a6ad0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:04.955167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bf6f-3a2e-4cf4-8071-d0fb6e67956c None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:04.955561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bf6f-3a2e-4cf4-8071-d0fb6e67956c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:04.956014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bf6f-3a2e-4cf4-8071-d0fb6e67956c None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:04.957902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 671/1371] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:04.963188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908251ef-648c-46c4-b845-55271d8ebca7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:04.963475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908251ef-648c-46c4-b845-55271d8ebca7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:04.963753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908251ef-648c-46c4-b845-55271d8ebca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:04.967484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158da7e7-fc8f-4360-aa89-21c3141a6ad0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:04.974045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608550d-4227-4b06-8e87-8317135c9cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:04.974860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608550d-4227-4b06-8e87-8317135c9cad service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:04.975277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608550d-4227-4b06-8e87-8317135c9cad service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:04.975707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608550d-4227-4b06-8e87-8317135c9cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:04.983459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-908251ef-648c-46c4-b845-55271d8ebca7 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:04.984701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-908251ef-648c-46c4-b845-55271d8ebca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:04.985960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608550d-4227-4b06-8e87-8317135c9cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:04.987888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608550d-4227-4b06-8e87-8317135c9cad service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:04.993282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 672/1372] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:04.998573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 701/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:05.294116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64cff-f98c-47e5-8a8e-ee1621b57a69 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:05.294116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64cff-f98c-47e5-8a8e-ee1621b57a69 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:05.294116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64cff-f98c-47e5-8a8e-ee1621b57a69 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:05.296764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 673/1374] 10.222.0.30 () {54 vars in 962 bytes} [Mon Apr 4 06:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:05.300951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749900-4334-430b-a9c7-2fe39e3d7b95 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:05.301274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749900-4334-430b-a9c7-2fe39e3d7b95 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:05.301528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749900-4334-430b-a9c7-2fe39e3d7b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:05.350216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ad749900-4334-430b-a9c7-2fe39e3d7b95 None None] MFA Rules not processed for user `7f0640518ddc4893b20b6d79c80c21ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:05.351427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ad749900-4334-430b-a9c7-2fe39e3d7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:05.415907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 702/1375] 10.222.0.30 () {58 vars in 1059 bytes} [Mon Apr 4 06:03:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:05.424059 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64cff-f98c-47e5-8a8e-ee1621b57a69 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:05.435506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64cff-f98c-47e5-8a8e-ee1621b57a69 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:05.439483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430da5b-bb9e-4d96-881a-05561dd3660a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:05.440132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430da5b-bb9e-4d96-881a-05561dd3660a service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:05.440421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430da5b-bb9e-4d96-881a-05561dd3660a service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:05.440672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430da5b-bb9e-4d96-881a-05561dd3660a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:05.450187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430da5b-bb9e-4d96-881a-05561dd3660a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:05.451617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430da5b-bb9e-4d96-881a-05561dd3660a service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:05.461432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 674/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:03:07.378548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00842a9-f805-443f-b7aa-fae008bfe3c4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:07.379135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00842a9-f805-443f-b7aa-fae008bfe3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:07.379135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00842a9-f805-443f-b7aa-fae008bfe3c4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:07.381037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 703/1377] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:07.386778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0acc6d-e61e-4be6-9a9b-bef2e51ef14d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:07.387314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0acc6d-e61e-4be6-9a9b-bef2e51ef14d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:07.387396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0acc6d-e61e-4be6-9a9b-bef2e51ef14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:07.407076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cf0acc6d-e61e-4be6-9a9b-bef2e51ef14d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:07.408335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cf0acc6d-e61e-4be6-9a9b-bef2e51ef14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:07.417201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 675/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:07.461770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00842a9-f805-443f-b7aa-fae008bfe3c4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:07.476931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00842a9-f805-443f-b7aa-fae008bfe3c4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:07.482493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded77db-983b-4eb4-837b-1182e1674bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:07.483163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded77db-983b-4eb4-837b-1182e1674bb9 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:07.483441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded77db-983b-4eb4-837b-1182e1674bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:07.483711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded77db-983b-4eb4-837b-1182e1674bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:07.492394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded77db-983b-4eb4-837b-1182e1674bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:07.494017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded77db-983b-4eb4-837b-1182e1674bb9 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:07.503547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 704/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:09.837398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659c7c-3254-49e8-b41a-3de0a04bf6c1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:09.837991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659c7c-3254-49e8-b41a-3de0a04bf6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:09.837991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659c7c-3254-49e8-b41a-3de0a04bf6c1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:09.844004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 676/1380] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:09.845312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039618-b93e-4a9e-af54-82c63dc55836 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:09.845749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039618-b93e-4a9e-af54-82c63dc55836 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:09.845835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039618-b93e-4a9e-af54-82c63dc55836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:09.866405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a7039618-b93e-4a9e-af54-82c63dc55836 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:09.867566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a7039618-b93e-4a9e-af54-82c63dc55836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:09.875967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 705/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:09.920098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28659c7c-3254-49e8-b41a-3de0a04bf6c1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:09.935638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28659c7c-3254-49e8-b41a-3de0a04bf6c1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:09.941340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403438-1ed5-436f-8e17-82f8a1c847ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:09.942056 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403438-1ed5-436f-8e17-82f8a1c847ad service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:09.942398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403438-1ed5-436f-8e17-82f8a1c847ad service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:09.942738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403438-1ed5-436f-8e17-82f8a1c847ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:09.951151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403438-1ed5-436f-8e17-82f8a1c847ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:09.952790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403438-1ed5-436f-8e17-82f8a1c847ad service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:09.962409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 677/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:12.314959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db8e6-d60f-4e06-ae67-aa6b5b3b63c8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:12.315540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db8e6-d60f-4e06-ae67-aa6b5b3b63c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:12.315540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db8e6-d60f-4e06-ae67-aa6b5b3b63c8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:12.321277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 706/1383] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:12.322835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931c78-4ee0-4a69-acaf-5f06f0246c1d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:12.323261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931c78-4ee0-4a69-acaf-5f06f0246c1d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:12.323388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931c78-4ee0-4a69-acaf-5f06f0246c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:12.343713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0d931c78-4ee0-4a69-acaf-5f06f0246c1d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:12.344919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0d931c78-4ee0-4a69-acaf-5f06f0246c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:12.353300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 678/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:12.395881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db8e6-d60f-4e06-ae67-aa6b5b3b63c8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:12.410462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199db8e6-d60f-4e06-ae67-aa6b5b3b63c8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:12.416060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbabdb0-77cb-4271-a123-d14228b58947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:12.416933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabdb0-77cb-4271-a123-d14228b58947 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:12.417219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabdb0-77cb-4271-a123-d14228b58947 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:12.417507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabdb0-77cb-4271-a123-d14228b58947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:12.426338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbabdb0-77cb-4271-a123-d14228b58947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:12.427918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbabdb0-77cb-4271-a123-d14228b58947 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:12.437228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 707/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:15.113724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b665e-8f97-4cc5-974b-4d2718e6b789 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:15.114260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b665e-8f97-4cc5-974b-4d2718e6b789 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:15.114394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b665e-8f97-4cc5-974b-4d2718e6b789 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:15.116936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 679/1386] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:15.123144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058ee42-cf6c-4552-8c81-a3a2fc1b6a02 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:15.123828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058ee42-cf6c-4552-8c81-a3a2fc1b6a02 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:15.123828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058ee42-cf6c-4552-8c81-a3a2fc1b6a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:15.148942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4058ee42-cf6c-4552-8c81-a3a2fc1b6a02 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:15.150679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4058ee42-cf6c-4552-8c81-a3a2fc1b6a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:15.163535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 708/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:15.220503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b665e-8f97-4cc5-974b-4d2718e6b789 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:15.237199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b665e-8f97-4cc5-974b-4d2718e6b789 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:15.244185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75bbcf-fa3a-445e-b2df-6cad658078cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:15.244862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bbcf-fa3a-445e-b2df-6cad658078cf service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:15.245179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bbcf-fa3a-445e-b2df-6cad658078cf service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:15.245487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bbcf-fa3a-445e-b2df-6cad658078cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:15.254676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75bbcf-fa3a-445e-b2df-6cad658078cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:15.256342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75bbcf-fa3a-445e-b2df-6cad658078cf service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:15.268042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 680/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:18.042384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a8ead-9ad8-4b54-8b89-d96faad1f9d4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:18.042937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a8ead-9ad8-4b54-8b89-d96faad1f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:18.043124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a8ead-9ad8-4b54-8b89-d96faad1f9d4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:18.046197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 709/1389] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:18.053457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1020bb-96ea-4e0e-88d1-37e93738b3d9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:18.053980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1020bb-96ea-4e0e-88d1-37e93738b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:18.054082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1020bb-96ea-4e0e-88d1-37e93738b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:18.073823 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3c1020bb-96ea-4e0e-88d1-37e93738b3d9 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:18.075237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3c1020bb-96ea-4e0e-88d1-37e93738b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:18.083999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 681/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:18.132374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a8ead-9ad8-4b54-8b89-d96faad1f9d4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:18.148658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a8ead-9ad8-4b54-8b89-d96faad1f9d4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:18.154868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b491e6-5fac-4499-966b-7f4702e33fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:18.155530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b491e6-5fac-4499-966b-7f4702e33fb7 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:18.155813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b491e6-5fac-4499-966b-7f4702e33fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:18.156081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b491e6-5fac-4499-966b-7f4702e33fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:18.165111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b491e6-5fac-4499-966b-7f4702e33fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:18.166758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b491e6-5fac-4499-966b-7f4702e33fb7 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:18.177715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 710/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:20.572338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884074a-c663-4022-929e-7d1eed2fc6c7 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:20.573011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884074a-c663-4022-929e-7d1eed2fc6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:20.573011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884074a-c663-4022-929e-7d1eed2fc6c7 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:20.574726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 682/1392] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:20.580099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95195-87ad-4569-bb49-f24b06a18be2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:20.580558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95195-87ad-4569-bb49-f24b06a18be2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:20.580688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95195-87ad-4569-bb49-f24b06a18be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:20.599993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f6d95195-87ad-4569-bb49-f24b06a18be2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:20.601217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f6d95195-87ad-4569-bb49-f24b06a18be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:20.610864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 711/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:20.654491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884074a-c663-4022-929e-7d1eed2fc6c7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:20.669860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884074a-c663-4022-929e-7d1eed2fc6c7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:20.675808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fce54e-d061-4b10-a64f-9665ff82fc82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:20.676456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce54e-d061-4b10-a64f-9665ff82fc82 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:20.676731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce54e-d061-4b10-a64f-9665ff82fc82 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:20.677024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce54e-d061-4b10-a64f-9665ff82fc82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:20.686086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce54e-d061-4b10-a64f-9665ff82fc82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:20.687666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce54e-d061-4b10-a64f-9665ff82fc82 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:20.697469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 683/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:21.628559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5e02-8a1a-43d5-8721-a6596b23a7ed None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:21.629212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5e02-8a1a-43d5-8721-a6596b23a7ed None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:21.629212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5e02-8a1a-43d5-8721-a6596b23a7ed None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:21.630802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 712/1395] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:21.638290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9849c8-7563-4d75-a48e-ab255decb43a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:21.638769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9849c8-7563-4d75-a48e-ab255decb43a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:21.639183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9849c8-7563-4d75-a48e-ab255decb43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:21.659623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ca9849c8-7563-4d75-a48e-ab255decb43a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:21.661642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ca9849c8-7563-4d75-a48e-ab255decb43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:21.670060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 684/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:21.728718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3282c7-3b3a-4c2b-bee7-b7ea478ba377 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:21.729064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3282c7-3b3a-4c2b-bee7-b7ea478ba377 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:21.729317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3282c7-3b3a-4c2b-bee7-b7ea478ba377 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:21.731093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 713/1397] 10.222.0.30 () {54 vars in 961 bytes} [Mon Apr 4 06:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:21.736583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b43c-adb1-4dad-8cc8-e544187b9449 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:21.737022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b43c-adb1-4dad-8cc8-e544187b9449 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:21.737299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637b43c-adb1-4dad-8cc8-e544187b9449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:21.790615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6637b43c-adb1-4dad-8cc8-e544187b9449 None None] MFA Rules not processed for user `1e1cdcbf35ed49a1b130757f7230e5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:21.791827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6637b43c-adb1-4dad-8cc8-e544187b9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:21.860024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 685/1398] 10.222.0.30 () {58 vars in 1058 bytes} [Mon Apr 4 06:03:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:21.867807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3282c7-3b3a-4c2b-bee7-b7ea478ba377 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:21.880080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3282c7-3b3a-4c2b-bee7-b7ea478ba377 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:21.884289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e3e8a-3e17-4bfd-a99d-f049bb63b56e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:21.884990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e3e8a-3e17-4bfd-a99d-f049bb63b56e service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:21.885227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e3e8a-3e17-4bfd-a99d-f049bb63b56e service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:21.885497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e3e8a-3e17-4bfd-a99d-f049bb63b56e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:21.895303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e3e8a-3e17-4bfd-a99d-f049bb63b56e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:21.896719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e3e8a-3e17-4bfd-a99d-f049bb63b56e service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:21.906401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 714/1399] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:22.327000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bb7a-66a5-4d01-91ba-374366b20073 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:22.327352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bb7a-66a5-4d01-91ba-374366b20073 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:22.327636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bb7a-66a5-4d01-91ba-374366b20073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:22.376414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-99d3bb7a-66a5-4d01-91ba-374366b20073 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:22.377646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-99d3bb7a-66a5-4d01-91ba-374366b20073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:22.439947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 686/1400] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:03:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:22.480336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e51c2b-0967-47ef-bfba-8af44eb2a4de None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:22.480614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e51c2b-0967-47ef-bfba-8af44eb2a4de None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:22.480880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e51c2b-0967-47ef-bfba-8af44eb2a4de None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:22.482740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 715/1401] 10.222.0.30 () {54 vars in 942 bytes} [Mon Apr 4 06:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:22.489149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0f189-4498-4b12-a766-f0c882208055 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:22.489436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0f189-4498-4b12-a766-f0c882208055 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:22.489734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0f189-4498-4b12-a766-f0c882208055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:22.539572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c4b0f189-4498-4b12-a766-f0c882208055 None None] MFA Rules not processed for user `a9357bd3de9b4dbebed74a1dcd6420c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:22.540743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c4b0f189-4498-4b12-a766-f0c882208055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:22.625841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 687/1402] 10.222.0.30 () {58 vars in 1039 bytes} [Mon Apr 4 06:03:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:22.635596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e51c2b-0967-47ef-bfba-8af44eb2a4de None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:22.650052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e51c2b-0967-47ef-bfba-8af44eb2a4de None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:22.655651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82997982-f9d3-4d7f-a2b8-f8971656167b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:22.656642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82997982-f9d3-4d7f-a2b8-f8971656167b service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:22.657141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82997982-f9d3-4d7f-a2b8-f8971656167b service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:22.657668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82997982-f9d3-4d7f-a2b8-f8971656167b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:22.667412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82997982-f9d3-4d7f-a2b8-f8971656167b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:22.669289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82997982-f9d3-4d7f-a2b8-f8971656167b service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:22.680932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 716/1403] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:03:23.042901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595725fa-e65b-4f87-8a0d-7b61e31f5bd3 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:23.043458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595725fa-e65b-4f87-8a0d-7b61e31f5bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:23.043458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595725fa-e65b-4f87-8a0d-7b61e31f5bd3 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:23.045270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 688/1404] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:23.051140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9598c-c0a6-4852-8fed-58624c9ab9e4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:23.051704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9598c-c0a6-4852-8fed-58624c9ab9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:23.051999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9598c-c0a6-4852-8fed-58624c9ab9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:23.071036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6fa9598c-c0a6-4852-8fed-58624c9ab9e4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:23.072239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6fa9598c-c0a6-4852-8fed-58624c9ab9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:23.083033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 717/1405] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:23.127489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595725fa-e65b-4f87-8a0d-7b61e31f5bd3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:23.143829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595725fa-e65b-4f87-8a0d-7b61e31f5bd3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:23.149407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8906db-eb3d-4415-af20-2e6c9ac207af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:23.150141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8906db-eb3d-4415-af20-2e6c9ac207af service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:23.150425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8906db-eb3d-4415-af20-2e6c9ac207af service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:23.150697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8906db-eb3d-4415-af20-2e6c9ac207af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:23.159468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8906db-eb3d-4415-af20-2e6c9ac207af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:23.161169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8906db-eb3d-4415-af20-2e6c9ac207af service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:23.170899 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 689/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:25.564400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38c8d8-521b-4de4-81fb-f44e19dfb189 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:25.564973 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38c8d8-521b-4de4-81fb-f44e19dfb189 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:25.565069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38c8d8-521b-4de4-81fb-f44e19dfb189 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:25.566835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 718/1407] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:25.572229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d21467-0a65-498d-8c8b-c48dd9689b97 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:25.572684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d21467-0a65-498d-8c8b-c48dd9689b97 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:25.572790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d21467-0a65-498d-8c8b-c48dd9689b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:25.593728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f3d21467-0a65-498d-8c8b-c48dd9689b97 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:25.594956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f3d21467-0a65-498d-8c8b-c48dd9689b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:25.603075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 690/1408] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:25.647760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38c8d8-521b-4de4-81fb-f44e19dfb189 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:25.662419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38c8d8-521b-4de4-81fb-f44e19dfb189 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:25.668232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498cc4f-a5ec-4b69-bfaa-409ca1ec4c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:25.669011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cc4f-a5ec-4b69-bfaa-409ca1ec4c33 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:25.669296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cc4f-a5ec-4b69-bfaa-409ca1ec4c33 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:25.669574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cc4f-a5ec-4b69-bfaa-409ca1ec4c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:25.677853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498cc4f-a5ec-4b69-bfaa-409ca1ec4c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:25.679447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498cc4f-a5ec-4b69-bfaa-409ca1ec4c33 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:25.689169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 719/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:45.849672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc6207-128f-4ac7-8c6e-f280a2561ae8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:45.850185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc6207-128f-4ac7-8c6e-f280a2561ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:45.850286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc6207-128f-4ac7-8c6e-f280a2561ae8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:45.852029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 691/1410] 10.222.0.30 () {54 vars in 918 bytes} [Mon Apr 4 06:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:45.858551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c6f0-a15d-4344-9604-a0481211fce8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:45.858987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c6f0-a15d-4344-9604-a0481211fce8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:45.859084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c6f0-a15d-4344-9604-a0481211fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:45.879257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7016c6f0-a15d-4344-9604-a0481211fce8 None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:45.880530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7016c6f0-a15d-4344-9604-a0481211fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:45.891915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 720/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Mon Apr 4 06:03:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:45.914373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179cda-3220-48fe-b3d2-bc485eb44671 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:45.914818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179cda-3220-48fe-b3d2-bc485eb44671 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:45.915260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179cda-3220-48fe-b3d2-bc485eb44671 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:45.918125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 692/1412] 10.222.0.30 () {54 vars in 918 bytes} [Mon Apr 4 06:03:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:45.923477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187ce1-4c72-411e-b6aa-115c32593650 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:45.923757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187ce1-4c72-411e-b6aa-115c32593650 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:45.924037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187ce1-4c72-411e-b6aa-115c32593650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:45.943690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc187ce1-4c72-411e-b6aa-115c32593650 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:45.944889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc187ce1-4c72-411e-b6aa-115c32593650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:45.955814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 721/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Mon Apr 4 06:03:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:48.769214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997d0-a802-492e-8646-5388d71f7282 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:48.769815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997d0-a802-492e-8646-5388d71f7282 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:48.769815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997d0-a802-492e-8646-5388d71f7282 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:48.771553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:48.777937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7ad63-bac6-4859-8d86-8b33398b6cc2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:48.778937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7ad63-bac6-4859-8d86-8b33398b6cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:48.778937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7ad63-bac6-4859-8d86-8b33398b6cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:48.804305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c4a7ad63-bac6-4859-8d86-8b33398b6cc2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:48.805539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c4a7ad63-bac6-4859-8d86-8b33398b6cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:48.814784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:48.856557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a997d0-a802-492e-8646-5388d71f7282 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:48.872063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a997d0-a802-492e-8646-5388d71f7282 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:48.878374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c5a5e-d170-471c-aba2-9ac0016efd60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:48.879007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c5a5e-d170-471c-aba2-9ac0016efd60 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:48.879286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c5a5e-d170-471c-aba2-9ac0016efd60 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:48.879560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c5a5e-d170-471c-aba2-9ac0016efd60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:48.887658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c5a5e-d170-471c-aba2-9ac0016efd60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:48.889650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c5a5e-d170-471c-aba2-9ac0016efd60 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:48.900082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 694/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:50.265410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8729-623a-48e6-9c0f-24366badf096 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:50.266286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8729-623a-48e6-9c0f-24366badf096 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:50.266286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8729-623a-48e6-9c0f-24366badf096 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:50.269402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:50.276794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc43b-ee5f-4890-a86f-9950a5c78a95 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:50.277245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc43b-ee5f-4890-a86f-9950a5c78a95 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:50.277347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fc43b-ee5f-4890-a86f-9950a5c78a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:50.300539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b18fc43b-ee5f-4890-a86f-9950a5c78a95 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:50.302292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b18fc43b-ee5f-4890-a86f-9950a5c78a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:50.314830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:50.501138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc8729-623a-48e6-9c0f-24366badf096 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:50.523227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc8729-623a-48e6-9c0f-24366badf096 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:50.531315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572b3c-c390-4434-960d-a82763a22292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:50.531956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572b3c-c390-4434-960d-a82763a22292 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:50.532230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572b3c-c390-4434-960d-a82763a22292 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:50.532499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572b3c-c390-4434-960d-a82763a22292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:50.541221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572b3c-c390-4434-960d-a82763a22292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:50.542811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572b3c-c390-4434-960d-a82763a22292 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:50.552549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 724/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:51.883615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51825692-4bc4-458e-8dde-c0aabdf5cc28 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:51.884164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51825692-4bc4-458e-8dde-c0aabdf5cc28 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:51.884164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51825692-4bc4-458e-8dde-c0aabdf5cc28 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:51.885975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:51.892246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479afe2-b3f3-4440-a8c3-414e7b78db84 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:51.893088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479afe2-b3f3-4440-a8c3-414e7b78db84 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:51.893191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479afe2-b3f3-4440-a8c3-414e7b78db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:51.921744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9479afe2-b3f3-4440-a8c3-414e7b78db84 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:51.922940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9479afe2-b3f3-4440-a8c3-414e7b78db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:51.933117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:52.089023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51825692-4bc4-458e-8dde-c0aabdf5cc28 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:52.106300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51825692-4bc4-458e-8dde-c0aabdf5cc28 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:52.114342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938a94a-8382-456b-ae56-e06d8c004e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:52.115264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938a94a-8382-456b-ae56-e06d8c004e7a service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:52.115586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938a94a-8382-456b-ae56-e06d8c004e7a service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:52.115880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938a94a-8382-456b-ae56-e06d8c004e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:52.124855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938a94a-8382-456b-ae56-e06d8c004e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:52.126454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938a94a-8382-456b-ae56-e06d8c004e7a service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:52.136218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 697/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:53.453434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095499-d544-4a62-b3ec-0cbb991847aa None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:53.454252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095499-d544-4a62-b3ec-0cbb991847aa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:53.454252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095499-d544-4a62-b3ec-0cbb991847aa None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:53.457189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:53.463295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5e36-14ce-4da3-8961-0059159ac32a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:53.464048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5e36-14ce-4da3-8961-0059159ac32a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:53.464193 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e5e36-14ce-4da3-8961-0059159ac32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:53.489584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9c1e5e36-14ce-4da3-8961-0059159ac32a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:53.490812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9c1e5e36-14ce-4da3-8961-0059159ac32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:53.499358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:53.670532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095499-d544-4a62-b3ec-0cbb991847aa None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:53.692068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095499-d544-4a62-b3ec-0cbb991847aa None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:53.699350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf9838-c9b8-43b5-a0d9-2b0f6c54bafe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:53.699989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf9838-c9b8-43b5-a0d9-2b0f6c54bafe service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:53.700268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf9838-c9b8-43b5-a0d9-2b0f6c54bafe service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:53.700578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf9838-c9b8-43b5-a0d9-2b0f6c54bafe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:53.709309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf9838-c9b8-43b5-a0d9-2b0f6c54bafe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:53.710796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf9838-c9b8-43b5-a0d9-2b0f6c54bafe service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:53.720526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 727/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:55.012989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c733746-abcb-48e2-af00-9ed93b10b6b1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:55.014198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c733746-abcb-48e2-af00-9ed93b10b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:55.014198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c733746-abcb-48e2-af00-9ed93b10b6b1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:55.017014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:55.025058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3a32c-7328-4260-b214-e92be0224e9c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:55.025489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3a32c-7328-4260-b214-e92be0224e9c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:55.025606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3a32c-7328-4260-b214-e92be0224e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:55.044945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bed3a32c-7328-4260-b214-e92be0224e9c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:55.046132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bed3a32c-7328-4260-b214-e92be0224e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:55.054434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:55.207725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c733746-abcb-48e2-af00-9ed93b10b6b1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:55.230163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c733746-abcb-48e2-af00-9ed93b10b6b1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:55.237832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f602b49-c345-4f1f-93ce-139e42969906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:55.238471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f602b49-c345-4f1f-93ce-139e42969906 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:55.238750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f602b49-c345-4f1f-93ce-139e42969906 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:55.239021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f602b49-c345-4f1f-93ce-139e42969906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:55.247645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f602b49-c345-4f1f-93ce-139e42969906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:55.249258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f602b49-c345-4f1f-93ce-139e42969906 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:55.259046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 700/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:56.498311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93555b9-f274-45e4-9644-c663c901fada None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:56.498849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93555b9-f274-45e4-9644-c663c901fada None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:56.498849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93555b9-f274-45e4-9644-c663c901fada None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:56.500555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:56.506761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde566cc-9919-412e-bd9a-573eaa544699 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:56.507216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde566cc-9919-412e-bd9a-573eaa544699 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:56.507321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde566cc-9919-412e-bd9a-573eaa544699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:56.533955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dde566cc-9919-412e-bd9a-573eaa544699 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:56.535151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dde566cc-9919-412e-bd9a-573eaa544699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:56.542974 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:56.698535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93555b9-f274-45e4-9644-c663c901fada None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:56.719935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93555b9-f274-45e4-9644-c663c901fada None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:56.725431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6e40c-9bb5-4e0e-b169-6b7a581ea19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:56.726073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e40c-9bb5-4e0e-b169-6b7a581ea19d service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:56.726351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e40c-9bb5-4e0e-b169-6b7a581ea19d service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:56.726624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6e40c-9bb5-4e0e-b169-6b7a581ea19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:56.735237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e40c-9bb5-4e0e-b169-6b7a581ea19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:56.736869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6e40c-9bb5-4e0e-b169-6b7a581ea19d service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:56.746358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 730/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:03:57.983525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f35758-9e65-4048-acf1-bc0aa756d801 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:57.984112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f35758-9e65-4048-acf1-bc0aa756d801 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:57.984112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f35758-9e65-4048-acf1-bc0aa756d801 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:57.985940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:57.991210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3fc7-b116-4f76-84bb-875ee78cb9cc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:57.991630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3fc7-b116-4f76-84bb-875ee78cb9cc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:57.991721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3fc7-b116-4f76-84bb-875ee78cb9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:58.011583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-45ef3fc7-b116-4f76-84bb-875ee78cb9cc None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:58.012783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45ef3fc7-b116-4f76-84bb-875ee78cb9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:58.022519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:03:58.176389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f35758-9e65-4048-acf1-bc0aa756d801 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:58.196279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f35758-9e65-4048-acf1-bc0aa756d801 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:58.202519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2bb4a-f153-494a-ac22-c71b8b2b5dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:58.203151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2bb4a-f153-494a-ac22-c71b8b2b5dd8 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:58.203431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2bb4a-f153-494a-ac22-c71b8b2b5dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:58.203704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2bb4a-f153-494a-ac22-c71b8b2b5dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:58.212046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2bb4a-f153-494a-ac22-c71b8b2b5dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:58.213723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2bb4a-f153-494a-ac22-c71b8b2b5dd8 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:58.223673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 703/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:03:59.480574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d320-aee6-4ab3-b38c-643874d49dd1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:59.481123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d320-aee6-4ab3-b38c-643874d49dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:59.481123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411d320-aee6-4ab3-b38c-643874d49dd1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:59.483039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:03:59.490859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d1998-d825-4843-94ae-fc7614036606 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:59.491280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d1998-d825-4843-94ae-fc7614036606 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:59.491410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d1998-d825-4843-94ae-fc7614036606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:59.512949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-199d1998-d825-4843-94ae-fc7614036606 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:03:59.514190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-199d1998-d825-4843-94ae-fc7614036606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:03:59.523495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:03:59.674745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d320-aee6-4ab3-b38c-643874d49dd1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:03:59.694802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411d320-aee6-4ab3-b38c-643874d49dd1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:03:59.701926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715626a-cf80-4c20-aef3-123933f0ca41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:03:59.702592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715626a-cf80-4c20-aef3-123933f0ca41 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:03:59.702870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715626a-cf80-4c20-aef3-123933f0ca41 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:03:59.703138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715626a-cf80-4c20-aef3-123933f0ca41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:03:59.711802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715626a-cf80-4c20-aef3-123933f0ca41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:03:59.713431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715626a-cf80-4c20-aef3-123933f0ca41 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:03:59.723473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 733/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:00.987776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa8f1-4439-48e1-88e4-9c9d28522091 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:00.988604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa8f1-4439-48e1-88e4-9c9d28522091 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:00.988782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaa8f1-4439-48e1-88e4-9c9d28522091 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:00.991683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:04:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:00.999494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827728-4041-46cf-bf4b-1b0fbd4d39a0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:00.999948 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827728-4041-46cf-bf4b-1b0fbd4d39a0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:01.000049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3827728-4041-46cf-bf4b-1b0fbd4d39a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:01.019046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e3827728-4041-46cf-bf4b-1b0fbd4d39a0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:01.020231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e3827728-4041-46cf-bf4b-1b0fbd4d39a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:01.028529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:01.182208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaa8f1-4439-48e1-88e4-9c9d28522091 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:01.202261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaa8f1-4439-48e1-88e4-9c9d28522091 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:01.211465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e88f-5fc5-42a5-8757-7982827436dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:01.212110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e88f-5fc5-42a5-8757-7982827436dd service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:01.212386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e88f-5fc5-42a5-8757-7982827436dd service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:01.212653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e88f-5fc5-42a5-8757-7982827436dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:01.222795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e88f-5fc5-42a5-8757-7982827436dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:01.224371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e88f-5fc5-42a5-8757-7982827436dd service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:01.235049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 706/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:03.438519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184031d2-626f-45c3-a679-b4e6a6f8a3dd None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:03.439338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184031d2-626f-45c3-a679-b4e6a6f8a3dd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:03.439338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184031d2-626f-45c3-a679-b4e6a6f8a3dd None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:03.442016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:03.449966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1805e-d218-4a68-818b-736e23ff7b30 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:03.450408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1805e-d218-4a68-818b-736e23ff7b30 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:03.450520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1805e-d218-4a68-818b-736e23ff7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:03.471210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b2f1805e-d218-4a68-818b-736e23ff7b30 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:03.472413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b2f1805e-d218-4a68-818b-736e23ff7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:03.480874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:03.519826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184031d2-626f-45c3-a679-b4e6a6f8a3dd None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:03.532476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184031d2-626f-45c3-a679-b4e6a6f8a3dd None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:03.536008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7d1d-716e-446b-a66c-0019a198f0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:03.536640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7d1d-716e-446b-a66c-0019a198f0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:03.536926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7d1d-716e-446b-a66c-0019a198f0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:03.537217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7d1d-716e-446b-a66c-0019a198f0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:03.546616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7d1d-716e-446b-a66c-0019a198f0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:03.548052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7d1d-716e-446b-a66c-0019a198f0d6 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:03.557565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 736/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:05.988004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dca7b-e7f5-4433-b0d2-7f5714d69502 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:05.989007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dca7b-e7f5-4433-b0d2-7f5714d69502 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:05.989007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dca7b-e7f5-4433-b0d2-7f5714d69502 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:05.991903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:05.998300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ce24-6790-43d3-890d-738acac9a6c2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:05.999071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ce24-6790-43d3-890d-738acac9a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:05.999521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ce24-6790-43d3-890d-738acac9a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:06.024663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bd22ce24-6790-43d3-890d-738acac9a6c2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:06.025897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bd22ce24-6790-43d3-890d-738acac9a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:06.035162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:06.077376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dca7b-e7f5-4433-b0d2-7f5714d69502 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:06.079409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dd3dca7b-e7f5-4433-b0d2-7f5714d69502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:06.093613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dca7b-e7f5-4433-b0d2-7f5714d69502 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:06.097369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952345b-7f07-41d5-a359-03ae6c2b04f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:06.097940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952345b-7f07-41d5-a359-03ae6c2b04f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:06.098221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952345b-7f07-41d5-a359-03ae6c2b04f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:06.098496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952345b-7f07-41d5-a359-03ae6c2b04f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:06.108312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952345b-7f07-41d5-a359-03ae6c2b04f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:06.109791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952345b-7f07-41d5-a359-03ae6c2b04f7 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:06.121809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 709/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:08.795158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b18b54-adc7-42b0-a5db-2796fdd883dc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:08.795752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b18b54-adc7-42b0-a5db-2796fdd883dc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:08.795752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b18b54-adc7-42b0-a5db-2796fdd883dc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:08.797521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:08.804002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427dd43-ca9b-470d-83a0-c38790c78811 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:08.804719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427dd43-ca9b-470d-83a0-c38790c78811 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:08.804873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427dd43-ca9b-470d-83a0-c38790c78811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:08.825950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3427dd43-ca9b-470d-83a0-c38790c78811 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:08.827325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3427dd43-ca9b-470d-83a0-c38790c78811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:08.836144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:08.875298 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b18b54-adc7-42b0-a5db-2796fdd883dc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:08.887233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b18b54-adc7-42b0-a5db-2796fdd883dc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:08.891965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e33c6a-f159-4207-bbe4-9fc24f085e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:08.892631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e33c6a-f159-4207-bbe4-9fc24f085e2b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:08.893302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e33c6a-f159-4207-bbe4-9fc24f085e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:08.893566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e33c6a-f159-4207-bbe4-9fc24f085e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:08.902896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e33c6a-f159-4207-bbe4-9fc24f085e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:08.904361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e33c6a-f159-4207-bbe4-9fc24f085e2b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:08.913831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 739/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:11.294795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34f95-09e3-4ec9-bb2a-4919c07c2aba None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:11.295386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34f95-09e3-4ec9-bb2a-4919c07c2aba None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:11.295386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34f95-09e3-4ec9-bb2a-4919c07c2aba None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:11.297183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:11.303674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559eee2-af0c-4568-a270-398e48ad464b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:11.304424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559eee2-af0c-4568-a270-398e48ad464b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:11.304588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559eee2-af0c-4568-a270-398e48ad464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:11.331561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1559eee2-af0c-4568-a270-398e48ad464b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:11.332770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1559eee2-af0c-4568-a270-398e48ad464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:11.341985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:11.379672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34f95-09e3-4ec9-bb2a-4919c07c2aba None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:11.391368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34f95-09e3-4ec9-bb2a-4919c07c2aba None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:11.395944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ae87-bc36-40c1-80dc-91ecd7cf34f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:11.396572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ae87-bc36-40c1-80dc-91ecd7cf34f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:11.396846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ae87-bc36-40c1-80dc-91ecd7cf34f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:11.397146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ae87-bc36-40c1-80dc-91ecd7cf34f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:11.406531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ae87-bc36-40c1-80dc-91ecd7cf34f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:11.407954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ae87-bc36-40c1-80dc-91ecd7cf34f9 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:11.417476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 712/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:04:13.795041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccd5e-cb88-45c4-a3fb-83ee3182b377 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:13.796059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccd5e-cb88-45c4-a3fb-83ee3182b377 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:13.796059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccd5e-cb88-45c4-a3fb-83ee3182b377 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:13.798850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:13.804450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2326-c9d9-4638-9cf1-eb3a5a5d9faf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:13.804965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2326-c9d9-4638-9cf1-eb3a5a5d9faf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:13.804965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2326-c9d9-4638-9cf1-eb3a5a5d9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:13.826014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2f2f2326-c9d9-4638-9cf1-eb3a5a5d9faf None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:13.827328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f2f2326-c9d9-4638-9cf1-eb3a5a5d9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:13.836459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:13.874904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ccd5e-cb88-45c4-a3fb-83ee3182b377 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:13.887720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ccd5e-cb88-45c4-a3fb-83ee3182b377 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:13.892240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dff36-0b7e-4162-bbec-7930a830ddf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:13.893288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dff36-0b7e-4162-bbec-7930a830ddf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:13.893570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dff36-0b7e-4162-bbec-7930a830ddf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:13.893850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dff36-0b7e-4162-bbec-7930a830ddf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:13.903351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dff36-0b7e-4162-bbec-7930a830ddf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:13.904869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dff36-0b7e-4162-bbec-7930a830ddf5 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:13.914534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 742/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:16.300352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c64e-e728-4d88-a82d-c2bfd550ea27 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:16.301283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c64e-e728-4d88-a82d-c2bfd550ea27 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:16.301283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c64e-e728-4d88-a82d-c2bfd550ea27 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:16.304083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:16.310585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e57c-adf3-4320-ba1c-1a3bacd90a5f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:16.311026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e57c-adf3-4320-ba1c-1a3bacd90a5f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:16.311142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e57c-adf3-4320-ba1c-1a3bacd90a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:16.331479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6581e57c-adf3-4320-ba1c-1a3bacd90a5f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:16.332682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6581e57c-adf3-4320-ba1c-1a3bacd90a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:16.342798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:16.380754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c64e-e728-4d88-a82d-c2bfd550ea27 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:16.395006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c64e-e728-4d88-a82d-c2bfd550ea27 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:16.398849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcb1ad-16be-4071-8368-0301882d02e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:16.399537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcb1ad-16be-4071-8368-0301882d02e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:16.399811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcb1ad-16be-4071-8368-0301882d02e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:16.400116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcb1ad-16be-4071-8368-0301882d02e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:16.409454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcb1ad-16be-4071-8368-0301882d02e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:16.410884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcb1ad-16be-4071-8368-0301882d02e8 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:16.420721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 715/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:18.766379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430e53-99e3-4046-afa6-3f5bda51ef74 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:18.767385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430e53-99e3-4046-afa6-3f5bda51ef74 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:18.767385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430e53-99e3-4046-afa6-3f5bda51ef74 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:18.770802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:18.776156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2b3b-5930-4ff1-9192-92bc82ec5dde None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:18.776591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2b3b-5930-4ff1-9192-92bc82ec5dde None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:18.776693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2b3b-5930-4ff1-9192-92bc82ec5dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:18.796320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-028b2b3b-5930-4ff1-9192-92bc82ec5dde None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:18.797525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-028b2b3b-5930-4ff1-9192-92bc82ec5dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:18.806588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:18.851055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430e53-99e3-4046-afa6-3f5bda51ef74 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:18.868265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430e53-99e3-4046-afa6-3f5bda51ef74 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:18.875027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8e98d-96b5-48de-8266-79dddc0df268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:18.875892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e98d-96b5-48de-8266-79dddc0df268 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:18.876148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e98d-96b5-48de-8266-79dddc0df268 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:18.876507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8e98d-96b5-48de-8266-79dddc0df268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:18.891819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8e98d-96b5-48de-8266-79dddc0df268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:18.894772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8e98d-96b5-48de-8266-79dddc0df268 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:18.912591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 745/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:21.241472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582c3d-ade4-43d6-9d67-192c4e0c4e49 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:21.242379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582c3d-ade4-43d6-9d67-192c4e0c4e49 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:21.242379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582c3d-ade4-43d6-9d67-192c4e0c4e49 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:21.245256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:21.250941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613280-7d59-442f-8e3d-698e9ca7eb69 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:21.251389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613280-7d59-442f-8e3d-698e9ca7eb69 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:21.251491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613280-7d59-442f-8e3d-698e9ca7eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:21.271117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-95613280-7d59-442f-8e3d-698e9ca7eb69 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:21.272288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-95613280-7d59-442f-8e3d-698e9ca7eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:21.281826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:21.322860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83582c3d-ade4-43d6-9d67-192c4e0c4e49 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:21.341848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83582c3d-ade4-43d6-9d67-192c4e0c4e49 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:21.345818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c785e2-0ad1-4d25-9552-32ce16b3244c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:21.346446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c785e2-0ad1-4d25-9552-32ce16b3244c service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:21.346725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c785e2-0ad1-4d25-9552-32ce16b3244c service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:21.346997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c785e2-0ad1-4d25-9552-32ce16b3244c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:21.356160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c785e2-0ad1-4d25-9552-32ce16b3244c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:21.357657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c785e2-0ad1-4d25-9552-32ce16b3244c service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:21.367259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 718/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:23.693027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9a187-a910-405d-b4a1-cf2298963e17 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:23.693623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9a187-a910-405d-b4a1-cf2298963e17 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:23.693623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9a187-a910-405d-b4a1-cf2298963e17 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:23.695323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:23.702126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc31b3-20b0-42b8-8f0b-628aa6491165 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:23.702552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc31b3-20b0-42b8-8f0b-628aa6491165 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:23.702714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc31b3-20b0-42b8-8f0b-628aa6491165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:23.724645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fcbc31b3-20b0-42b8-8f0b-628aa6491165 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:23.725856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fcbc31b3-20b0-42b8-8f0b-628aa6491165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:23.734777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:23.774820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9a187-a910-405d-b4a1-cf2298963e17 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:23.789265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9a187-a910-405d-b4a1-cf2298963e17 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:23.793494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7585441-7023-4321-9d40-130f3cc160a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:23.794122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585441-7023-4321-9d40-130f3cc160a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:23.794405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585441-7023-4321-9d40-130f3cc160a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:23.794696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7585441-7023-4321-9d40-130f3cc160a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:23.804375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7585441-7023-4321-9d40-130f3cc160a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:23.805834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7585441-7023-4321-9d40-130f3cc160a3 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:23.817145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 748/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:04:26.106927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c2922-7d6c-4087-a958-45af8982ccc5 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:26.107489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c2922-7d6c-4087-a958-45af8982ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:26.107489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c2922-7d6c-4087-a958-45af8982ccc5 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:26.109409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:26.115509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f733-f630-4d50-a037-82cda21d2e3e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:26.115962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f733-f630-4d50-a037-82cda21d2e3e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:26.116113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f733-f630-4d50-a037-82cda21d2e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:26.137311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b4c2f733-f630-4d50-a037-82cda21d2e3e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:26.139402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b4c2f733-f630-4d50-a037-82cda21d2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:26.153156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:26.193900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c2922-7d6c-4087-a958-45af8982ccc5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:26.208052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c2922-7d6c-4087-a958-45af8982ccc5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:26.212088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743467-3d57-44f7-9b43-60bf65ef16df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:26.212716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743467-3d57-44f7-9b43-60bf65ef16df service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:26.213045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743467-3d57-44f7-9b43-60bf65ef16df service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:26.213324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743467-3d57-44f7-9b43-60bf65ef16df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:26.223181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743467-3d57-44f7-9b43-60bf65ef16df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:26.224650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743467-3d57-44f7-9b43-60bf65ef16df service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:26.238485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 721/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:47.137960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b9d2-c517-4f19-9ba0-b0cae443cc6a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:47.138454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b9d2-c517-4f19-9ba0-b0cae443cc6a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:47.138557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b9d2-c517-4f19-9ba0-b0cae443cc6a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:47.140353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 750/1471] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:47.147002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bfe16-f7b6-4eab-be96-bfd7d8ed9a63 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:47.147456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bfe16-f7b6-4eab-be96-bfd7d8ed9a63 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:47.147558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bfe16-f7b6-4eab-be96-bfd7d8ed9a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:47.175766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1d1bfe16-f7b6-4eab-be96-bfd7d8ed9a63 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:47.177016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1d1bfe16-f7b6-4eab-be96-bfd7d8ed9a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:47.186502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 722/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:47.236383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e3907-5d3f-419f-ae34-797af99b4ebd None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:47.236666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e3907-5d3f-419f-ae34-797af99b4ebd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:47.236934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e3907-5d3f-419f-ae34-797af99b4ebd None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:47.238758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 751/1473] 10.222.0.30 () {54 vars in 961 bytes} [Mon Apr 4 06:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:47.243636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d21d-f515-4bf6-9b8e-0fd82d16942f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:47.243916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d21d-f515-4bf6-9b8e-0fd82d16942f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:47.244186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d21d-f515-4bf6-9b8e-0fd82d16942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:47.263639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-45f0d21d-f515-4bf6-9b8e-0fd82d16942f None None] MFA Rules not processed for user `1e1cdcbf35ed49a1b130757f7230e5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:47.265005 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-45f0d21d-f515-4bf6-9b8e-0fd82d16942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:47.275165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 723/1474] 10.222.0.30 () {58 vars in 1058 bytes} [Mon Apr 4 06:04:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:47.284103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e3907-5d3f-419f-ae34-797af99b4ebd None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:47.296936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e3907-5d3f-419f-ae34-797af99b4ebd None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:47.301033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476722-08af-48a8-87dc-aaece10e1053 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:47.301656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476722-08af-48a8-87dc-aaece10e1053 service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:47.301927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476722-08af-48a8-87dc-aaece10e1053 service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:47.302175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476722-08af-48a8-87dc-aaece10e1053 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:47.316051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6476722-08af-48a8-87dc-aaece10e1053 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:47.318377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6476722-08af-48a8-87dc-aaece10e1053 service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:47.331308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 752/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:49.783409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f32ac-cc9b-4dc0-a562-b1f035edcfe4 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:49.784309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f32ac-cc9b-4dc0-a562-b1f035edcfe4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:49.784309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f32ac-cc9b-4dc0-a562-b1f035edcfe4 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:49.787212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 724/1476] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:04:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:49.793596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec551d6-015f-4c5d-bfe8-cc20741e624d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:49.794357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec551d6-015f-4c5d-bfe8-cc20741e624d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:49.794527 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec551d6-015f-4c5d-bfe8-cc20741e624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:49.818386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-dec551d6-015f-4c5d-bfe8-cc20741e624d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:49.819578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dec551d6-015f-4c5d-bfe8-cc20741e624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:49.829247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 753/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:49.856347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f32ac-cc9b-4dc0-a562-b1f035edcfe4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:49.870913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f32ac-cc9b-4dc0-a562-b1f035edcfe4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:49.876779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:49.877459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:49.877717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:49.878013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:49.878732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:49.880479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:04:49.880479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:04:49.880479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:04:49.881637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff85590-9949-4533-9d1e-a45953eb7062 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:49.901334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 725/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Mon Apr 4 06:04:49 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:04:52.202860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c500-1a0b-4ae6-bc39-9ec8c368580b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:52.203427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c500-1a0b-4ae6-bc39-9ec8c368580b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:52.203427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c500-1a0b-4ae6-bc39-9ec8c368580b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:52.205097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 754/1479] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:52.211432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39ff2-c491-4cb5-940b-e86b55620d13 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:52.211894 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39ff2-c491-4cb5-940b-e86b55620d13 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:52.211999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39ff2-c491-4cb5-940b-e86b55620d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:52.233644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cfb39ff2-c491-4cb5-940b-e86b55620d13 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:52.234936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cfb39ff2-c491-4cb5-940b-e86b55620d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:52.244410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 726/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:52.290866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c500-1a0b-4ae6-bc39-9ec8c368580b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:52.313786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c500-1a0b-4ae6-bc39-9ec8c368580b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:52.320415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599898cb-f0f5-411e-a22a-9df4bcd9eb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:52.321089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599898cb-f0f5-411e-a22a-9df4bcd9eb78 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:52.321368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599898cb-f0f5-411e-a22a-9df4bcd9eb78 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:52.321638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599898cb-f0f5-411e-a22a-9df4bcd9eb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:52.330308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599898cb-f0f5-411e-a22a-9df4bcd9eb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:52.331897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599898cb-f0f5-411e-a22a-9df4bcd9eb78 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:52.345472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 755/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:54.829131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d87a4-54fe-48d6-b9ab-bc32b134d27d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:54.829693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d87a4-54fe-48d6-b9ab-bc32b134d27d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:54.829693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d87a4-54fe-48d6-b9ab-bc32b134d27d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:54.831533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 727/1482] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:54.837258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282be84-98c2-4282-a6bd-6493c05a580f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:54.837735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282be84-98c2-4282-a6bd-6493c05a580f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:54.837838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282be84-98c2-4282-a6bd-6493c05a580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:54.861069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6282be84-98c2-4282-a6bd-6493c05a580f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:54.862261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6282be84-98c2-4282-a6bd-6493c05a580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:54.870693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 756/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:04:54.909345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d87a4-54fe-48d6-b9ab-bc32b134d27d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:54.922277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d87a4-54fe-48d6-b9ab-bc32b134d27d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:54.926674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ead14-4a64-4e53-9693-8bcf68aae90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:54.927308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ead14-4a64-4e53-9693-8bcf68aae90f service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:54.927585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ead14-4a64-4e53-9693-8bcf68aae90f service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:54.927854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ead14-4a64-4e53-9693-8bcf68aae90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:54.937210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ead14-4a64-4e53-9693-8bcf68aae90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:54.938638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ead14-4a64-4e53-9693-8bcf68aae90f service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:54.948012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 728/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:57.283473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43347e-4d2d-4220-9eb8-09071be42801 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:57.284430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43347e-4d2d-4220-9eb8-09071be42801 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:57.284430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43347e-4d2d-4220-9eb8-09071be42801 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:57.287354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 757/1485] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:04:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:57.292760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c95fd-a1d8-476b-960a-469da8eaaffa None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:57.293211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c95fd-a1d8-476b-960a-469da8eaaffa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:57.293323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c95fd-a1d8-476b-960a-469da8eaaffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:57.313179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-751c95fd-a1d8-476b-960a-469da8eaaffa None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:57.314365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-751c95fd-a1d8-476b-960a-469da8eaaffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:57.323241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 729/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:57.361107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43347e-4d2d-4220-9eb8-09071be42801 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:57.373500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43347e-4d2d-4220-9eb8-09071be42801 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:57.377922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ab52-d2db-4ea8-8359-44ad2d14f877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:57.378572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ab52-d2db-4ea8-8359-44ad2d14f877 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:57.378854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ab52-d2db-4ea8-8359-44ad2d14f877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:57.379130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ab52-d2db-4ea8-8359-44ad2d14f877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:57.388294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0ab52-d2db-4ea8-8359-44ad2d14f877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:04:57.389684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0ab52-d2db-4ea8-8359-44ad2d14f877 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:04:57.399546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 758/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:04:59.880671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbd6e-5471-45ab-a286-44f126f5be5c None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:59.881297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbd6e-5471-45ab-a286-44f126f5be5c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:59.881297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbd6e-5471-45ab-a286-44f126f5be5c None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:59.883055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 730/1488] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:04:59.888525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a8e21-9766-4d1d-8f55-82022479c71e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:59.888977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a8e21-9766-4d1d-8f55-82022479c71e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:59.889068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a8e21-9766-4d1d-8f55-82022479c71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:04:59.910151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ac3a8e21-9766-4d1d-8f55-82022479c71e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:04:59.911351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ac3a8e21-9766-4d1d-8f55-82022479c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:04:59.921621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 759/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:04:59.976556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbd6e-5471-45ab-a286-44f126f5be5c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:04:59.991720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbd6e-5471-45ab-a286-44f126f5be5c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:04:59.996288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210a2f2-9b90-4a32-b1dd-d998e66258fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:04:59.996936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210a2f2-9b90-4a32-b1dd-d998e66258fa service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:04:59.997235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210a2f2-9b90-4a32-b1dd-d998e66258fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:04:59.997508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210a2f2-9b90-4a32-b1dd-d998e66258fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:05:00.007271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210a2f2-9b90-4a32-b1dd-d998e66258fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:05:00.008701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210a2f2-9b90-4a32-b1dd-d998e66258fa service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:05:00.018544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 731/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:05:02.560123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3cf0-2d33-486a-9d7c-c5e1601a37dc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:05:02.561022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3cf0-2d33-486a-9d7c-c5e1601a37dc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:05:02.561022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3cf0-2d33-486a-9d7c-c5e1601a37dc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:05:02.563197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 760/1491] 10.222.0.30 () {54 vars in 926 bytes} [Mon Apr 4 06:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:05:02.568531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61deac7e-e2e5-4583-8f0a-44b118ce6a31 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:05:02.568999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61deac7e-e2e5-4583-8f0a-44b118ce6a31 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:05:02.569094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61deac7e-e2e5-4583-8f0a-44b118ce6a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:05:02.588178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-61deac7e-e2e5-4583-8f0a-44b118ce6a31 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:05:02.589384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-61deac7e-e2e5-4583-8f0a-44b118ce6a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:05:02.597955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 732/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Mon Apr 4 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:05:02.639815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3cf0-2d33-486a-9d7c-c5e1601a37dc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:05:02.658226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3cf0-2d33-486a-9d7c-c5e1601a37dc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:05:02.663356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27838095-59d8-4773-ac79-acc4d5c5346c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:05:02.664021 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838095-59d8-4773-ac79-acc4d5c5346c service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:05:02.664303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838095-59d8-4773-ac79-acc4d5c5346c service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:05:02.664569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838095-59d8-4773-ac79-acc4d5c5346c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:05:02.680828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27838095-59d8-4773-ac79-acc4d5c5346c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:05:02.683031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27838095-59d8-4773-ac79-acc4d5c5346c service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:05:02.698818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 761/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:06:23.371846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.372852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.372852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.398660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:06:23.399865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:06:23.409220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 733/1494] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:06:23.419029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.419604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.419604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.442092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:06:23.443818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:06:23.458106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 762/1495] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:06:23.462849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:23.473307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b74f4-0c7b-4338-812a-f565a6452b13 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:23.479124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:23.479782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.480062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.480333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.481099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:06:23.481384 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:23.482412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:23.482412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:06:23.482412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:06:23.483287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:23.495461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 734/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:06:23.504375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:23.518949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84dd16-a959-4070-8499-a10fe5bfda3d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:23.527742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:23.528579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.528873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.529299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.530064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:23.531882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:23.531882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:06:23.531882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:06:23.533120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:23.571675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 763/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:06:23 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:06:23.578397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:23.593624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34da16-6991-4cd1-a505-6a7fdd3d4e1e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:23.655574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:23.656226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.656715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.657021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.657708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:23.658738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:23.658738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:06:23.658738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:06:23.659954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:23.682171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 735/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:06:23 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:06:23.687109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:23.698314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21994d-77d7-463f-b904-6ec68b0cfd8d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:23.707815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:23.708479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.708755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.709057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.709783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:23.710846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:23.710846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:06:23.710846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:06:23.711718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:23.726292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 764/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:06:23.732747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:23.748026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846d4cc-d125-4560-bab4-8b893114f452 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:23.753019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:23.753696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.753955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.754224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.754948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:23.755973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:23.755973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:06:23.755973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:06:23.756843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7687267-d5ae-42f6-a20c-82b43315db57 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:23.772000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 736/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:06:23.778646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:23.789347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33354e-a957-4369-adf7-b1e6eb0de0e3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:23.795106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:23.795985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.796259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.796533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] PATH_INFO: `/v3/projects/b0bd1ffc32d245288c17d4282d1bb0e8/users/2671d4a2a77b473da575d4e22c5daaef/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.811918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0bd1ffc32d245288c17d4282d1bb0e8, user_id=2671d4a2a77b473da575d4e22c5daaef, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:23.812995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:23.812995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:06:23.812995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:06:23.814898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:23.830123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 765/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:06:23 2022] PUT /identity/v3/projects/b0bd1ffc32d245288c17d4282d1bb0e8/users/2671d4a2a77b473da575d4e22c5daaef/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:06:23.841673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dfa07-2779-436d-9076-520110d147fd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:23.841981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dfa07-2779-436d-9076-520110d147fd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:23.842249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dfa07-2779-436d-9076-520110d147fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:23.874018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-642dfa07-2779-436d-9076-520110d147fd None None] MFA Rules not processed for user `2671d4a2a77b473da575d4e22c5daaef`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:06:23.875782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-642dfa07-2779-436d-9076-520110d147fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:06:23.954723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 737/1502] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:06:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:06:23.966584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:24.049627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d9bb5-6868-42ea-98e7-f3bd9e832e71 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:24.056709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:24.057716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:24.058094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:24.058452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:24.068446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:24.070990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:24.080221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 766/1503] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:06:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:06:24.160663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc1f7-b447-48b6-85bd-377c26cd6fc3 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:24.160995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc1f7-b447-48b6-85bd-377c26cd6fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:24.161504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc1f7-b447-48b6-85bd-377c26cd6fc3 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:24.164150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 738/1504] 10.222.0.30 () {52 vars in 829 bytes} [Mon Apr 4 06:06:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:06:24.167960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:24.235034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd801f0-8ae0-446d-bdfd-900b2b8b6919 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:24.239998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:24.240861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:24.241164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:24.241438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] PATH_INFO: `/v3/users/2671d4a2a77b473da575d4e22c5daaef` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:24.242676 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2671d4a2a77b473da575d4e22c5daaef)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:24.243706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:24.243706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:06:24.243706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:06:24.244888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:24.315616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2671d4a2a77b473da575d4e22c5daaef'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:24.328354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2671d4a2a77b473da575d4e22c5daaef'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:24.348920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2671d4a2a77b473da575d4e22c5daaef'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:24.360278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2671d4a2a77b473da575d4e22c5daaef'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:24.361212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2671d4a2a77b473da575d4e22c5daaef'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:24.368043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 767/1505] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:06:24 2022] DELETE /identity/v3/users/2671d4a2a77b473da575d4e22c5daaef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:06:24.372843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:24.373378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:24.373378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:24.391108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:06:24.392306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:06:24.458737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 739/1506] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:06:24.470464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:24.472079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:06:24.530281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd691-477c-4ce4-9efc-48fea2c6dfd1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:24.536828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00833bf2-7f38-4789-aabd-5542a39709f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:24.537928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00833bf2-7f38-4789-aabd-5542a39709f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:24.538399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00833bf2-7f38-4789-aabd-5542a39709f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:24.538813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00833bf2-7f38-4789-aabd-5542a39709f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:24.551719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00833bf2-7f38-4789-aabd-5542a39709f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:24.553270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00833bf2-7f38-4789-aabd-5542a39709f7 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:24.562901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 768/1507] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:06:24.908605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:06:24.910184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:06:24.923812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dd545-2792-4880-b37c-25b1244e1757 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:06:24.929149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:06:24.930541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:06:24.930826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:06:24.931142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] PATH_INFO: `/v3/projects/b0bd1ffc32d245288c17d4282d1bb0e8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:06:24.932451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0bd1ffc32d245288c17d4282d1bb0e8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:06:24.934682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:06:24.934682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:06:24.934682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:06:24.936003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:06:25.000019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0bd1ffc32d245288c17d4282d1bb0e8', 'request_id': 'req-577b7f18-993a-4926-9039-2e3f8a562c5c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:25.011397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0bd1ffc32d245288c17d4282d1bb0e8', 'request_id': 'req-577b7f18-993a-4926-9039-2e3f8a562c5c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:25.025600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0bd1ffc32d245288c17d4282d1bb0e8', 'request_id': 'req-577b7f18-993a-4926-9039-2e3f8a562c5c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:25.036211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] The token cache is being invalidate because project b0bd1ffc32d245288c17d4282d1bb0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:06:25.036489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:25.037173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-577b7f18-993a-4926-9039-2e3f8a562c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:06:25.038828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 740/1508] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:06:24 2022] DELETE /identity/v3/projects/b0bd1ffc32d245288c17d4282d1bb0e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:07:59.058694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe42d0-8c24-4e22-b49a-b31ee226dfeb None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:07:59.059623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe42d0-8c24-4e22-b49a-b31ee226dfeb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:07:59.059623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe42d0-8c24-4e22-b49a-b31ee226dfeb None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:07:59.062823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 769/1509] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:07:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:07:59.070202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b07b9-4fcf-4b7b-98b7-f7e27d3517f4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:07:59.070686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b07b9-4fcf-4b7b-98b7-f7e27d3517f4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:07:59.070784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b07b9-4fcf-4b7b-98b7-f7e27d3517f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:07:59.090512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-eb1b07b9-4fcf-4b7b-98b7-f7e27d3517f4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:07:59.091862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-eb1b07b9-4fcf-4b7b-98b7-f7e27d3517f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:07:59.152863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 741/1510] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:07:59.321510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe42d0-8c24-4e22-b49a-b31ee226dfeb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:07:59.323512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f9fe42d0-8c24-4e22-b49a-b31ee226dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:07:59.400703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe42d0-8c24-4e22-b49a-b31ee226dfeb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:07:59.407389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b9f6-b050-4274-b996-e771bd39f479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:07:59.407980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b9f6-b050-4274-b996-e771bd39f479 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:07:59.408260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b9f6-b050-4274-b996-e771bd39f479 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:07:59.408524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b9f6-b050-4274-b996-e771bd39f479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:07:59.416706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b9f6-b050-4274-b996-e771bd39f479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:07:59.418314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b9f6-b050-4274-b996-e771bd39f479 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:07:59.428043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 770/1511] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:00.246228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8fa2-3e50-4355-8e5e-553844a909cb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:00.246761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8fa2-3e50-4355-8e5e-553844a909cb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:00.246761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8fa2-3e50-4355-8e5e-553844a909cb None None] PATH_INFO: `/v3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:00.248787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 742/1512] 10.222.0.37 () {54 vars in 925 bytes} [Mon Apr 4 06:08:00 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:08:00.255425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800532-bac7-4026-9bca-c6f5b44c3053 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:00.255925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800532-bac7-4026-9bca-c6f5b44c3053 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:00.256033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800532-bac7-4026-9bca-c6f5b44c3053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:00.276473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ae800532-bac7-4026-9bca-c6f5b44c3053 None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:00.277986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae800532-bac7-4026-9bca-c6f5b44c3053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:00.348198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 771/1513] 10.222.0.37 () {58 vars in 1015 bytes} [Mon Apr 4 06:08:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:00.722648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdffca-9f6f-4205-94c3-edc4ea11d193 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:00.723087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdffca-9f6f-4205-94c3-edc4ea11d193 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:00.723546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdffca-9f6f-4205-94c3-edc4ea11d193 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:00.726687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:08:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:00.734076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb2f12-8638-456f-8f2b-2381fef111aa None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:00.734367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb2f12-8638-456f-8f2b-2381fef111aa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:00.734644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb2f12-8638-456f-8f2b-2381fef111aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:00.754510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-10eb2f12-8638-456f-8f2b-2381fef111aa None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:00.755727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-10eb2f12-8638-456f-8f2b-2381fef111aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:00.764381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:00.923349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdffca-9f6f-4205-94c3-edc4ea11d193 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:00.944502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdffca-9f6f-4205-94c3-edc4ea11d193 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:00.952459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24159-7746-40ec-a94e-3ed43637c8cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:00.953132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24159-7746-40ec-a94e-3ed43637c8cc service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:00.953404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24159-7746-40ec-a94e-3ed43637c8cc service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:00.953670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24159-7746-40ec-a94e-3ed43637c8cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:00.963413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24159-7746-40ec-a94e-3ed43637c8cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:00.965077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24159-7746-40ec-a94e-3ed43637c8cc service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:00.975078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 744/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:04.352761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc2425-5d85-4e16-84b9-2907d1a63140 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:04.353368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc2425-5d85-4e16-84b9-2907d1a63140 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:04.353368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc2425-5d85-4e16-84b9-2907d1a63140 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:04.355108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 773/1517] 10.222.0.30 () {54 vars in 960 bytes} [Mon Apr 4 06:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:04.360931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4727d-f72b-42d9-b95f-e6b70f850db1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:04.361379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4727d-f72b-42d9-b95f-e6b70f850db1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:04.361503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4727d-f72b-42d9-b95f-e6b70f850db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:04.381881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-66c4727d-f72b-42d9-b95f-e6b70f850db1 None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:04.383068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-66c4727d-f72b-42d9-b95f-e6b70f850db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:04.393535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 745/1518] 10.222.0.30 () {58 vars in 1057 bytes} [Mon Apr 4 06:08:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:08:04.401069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc2425-5d85-4e16-84b9-2907d1a63140 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:04.415568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc2425-5d85-4e16-84b9-2907d1a63140 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:04.421073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebd6cb-0cd1-4996-a61c-6612b2068dc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:04.421999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebd6cb-0cd1-4996-a61c-6612b2068dc6 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:04.422345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebd6cb-0cd1-4996-a61c-6612b2068dc6 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:04.422622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebd6cb-0cd1-4996-a61c-6612b2068dc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:04.430926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebd6cb-0cd1-4996-a61c-6612b2068dc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:04.432507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebd6cb-0cd1-4996-a61c-6612b2068dc6 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:04.442254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 774/1519] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:08:12.693787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd7a8-b5dc-45d4-84e1-0ae8cadfa3d8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:12.694321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd7a8-b5dc-45d4-84e1-0ae8cadfa3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:12.694321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd7a8-b5dc-45d4-84e1-0ae8cadfa3d8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:12.696107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 746/1520] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:12.701484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b353d-fcff-42ba-be7d-56d72979b4eb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:12.701925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b353d-fcff-42ba-be7d-56d72979b4eb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:12.702036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b353d-fcff-42ba-be7d-56d72979b4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:12.723042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9f6b353d-fcff-42ba-be7d-56d72979b4eb None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:12.724292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9f6b353d-fcff-42ba-be7d-56d72979b4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:12.733704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 775/1521] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:12.884657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd7a8-b5dc-45d4-84e1-0ae8cadfa3d8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:12.907227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd7a8-b5dc-45d4-84e1-0ae8cadfa3d8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:12.914269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f219aa-4df4-4a9f-aa0a-478d95f88e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:12.914910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f219aa-4df4-4a9f-aa0a-478d95f88e33 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:12.915189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f219aa-4df4-4a9f-aa0a-478d95f88e33 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:12.915464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f219aa-4df4-4a9f-aa0a-478d95f88e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:12.924324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f219aa-4df4-4a9f-aa0a-478d95f88e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:12.926239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f219aa-4df4-4a9f-aa0a-478d95f88e33 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:12.936180 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 747/1522] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:14.243510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848dffc-5f20-4306-a24d-ff7129476eac None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:14.244044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848dffc-5f20-4306-a24d-ff7129476eac None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:14.244044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848dffc-5f20-4306-a24d-ff7129476eac None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:14.246719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 776/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 4 06:08:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:14.253938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1476a4-c56e-4386-8892-ea6633da8bf0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:14.254355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1476a4-c56e-4386-8892-ea6633da8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:14.254445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1476a4-c56e-4386-8892-ea6633da8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:14.274618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2b1476a4-c56e-4386-8892-ea6633da8bf0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:14.275816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2b1476a4-c56e-4386-8892-ea6633da8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:14.285515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 748/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 4 06:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:14.443318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848dffc-5f20-4306-a24d-ff7129476eac None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:14.469541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848dffc-5f20-4306-a24d-ff7129476eac None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:14.476802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31e678-5aed-4a8f-aba6-8097726a1257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:14.477485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31e678-5aed-4a8f-aba6-8097726a1257 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:14.477763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31e678-5aed-4a8f-aba6-8097726a1257 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:14.478032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31e678-5aed-4a8f-aba6-8097726a1257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:14.487048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31e678-5aed-4a8f-aba6-8097726a1257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:14.488858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31e678-5aed-4a8f-aba6-8097726a1257 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:14.501446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 777/1525] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:18.937356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8f192-6f31-46f8-94eb-6c1fe2f6620c None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:18.937944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8f192-6f31-46f8-94eb-6c1fe2f6620c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:18.937944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8f192-6f31-46f8-94eb-6c1fe2f6620c None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:18.939767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 749/1526] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:18.946474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca20bd-c325-4384-8bc7-03f064f77734 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:18.947221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca20bd-c325-4384-8bc7-03f064f77734 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:18.947393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca20bd-c325-4384-8bc7-03f064f77734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:18.976092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-94ca20bd-c325-4384-8bc7-03f064f77734 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:18.977312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-94ca20bd-c325-4384-8bc7-03f064f77734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:18.986833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 778/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:19.032458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8f192-6f31-46f8-94eb-6c1fe2f6620c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:19.035245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6fa8f192-6f31-46f8-94eb-6c1fe2f6620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:19.102327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8f192-6f31-46f8-94eb-6c1fe2f6620c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:19.106765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c683b7-5aa8-4378-935c-efba53426e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:19.107416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c683b7-5aa8-4378-935c-efba53426e5e service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:19.107720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c683b7-5aa8-4378-935c-efba53426e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:19.107987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c683b7-5aa8-4378-935c-efba53426e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:19.117381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c683b7-5aa8-4378-935c-efba53426e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:19.118815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c683b7-5aa8-4378-935c-efba53426e5e service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:19.128023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 750/1528] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:21.434874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faeddb-299d-47b5-b532-6b88be527131 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:21.435841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faeddb-299d-47b5-b532-6b88be527131 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:21.435841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faeddb-299d-47b5-b532-6b88be527131 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:21.438820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 779/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:08:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:21.445304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde303b-d6f0-452c-bf70-c655d5720057 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:21.446010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde303b-d6f0-452c-bf70-c655d5720057 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:21.446194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde303b-d6f0-452c-bf70-c655d5720057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:21.468893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bdde303b-d6f0-452c-bf70-c655d5720057 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:21.470118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bdde303b-d6f0-452c-bf70-c655d5720057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:21.478960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 751/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:21.517150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faeddb-299d-47b5-b532-6b88be527131 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:21.528807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faeddb-299d-47b5-b532-6b88be527131 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:21.532499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608febe-85ce-4d13-8068-354c7a244ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:21.533175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608febe-85ce-4d13-8068-354c7a244ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:21.533509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608febe-85ce-4d13-8068-354c7a244ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:21.533964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608febe-85ce-4d13-8068-354c7a244ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:21.543289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608febe-85ce-4d13-8068-354c7a244ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:21.544766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608febe-85ce-4d13-8068-354c7a244ef9 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:21.554449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 780/1531] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:25.330793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f1f5-25a0-4c99-8e3f-a03d8922c3bc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:25.331440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f1f5-25a0-4c99-8e3f-a03d8922c3bc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:25.331440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f1f5-25a0-4c99-8e3f-a03d8922c3bc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:25.333184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 752/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:25.339556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4773-e82d-4216-8797-7583428a0c13 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:25.340323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4773-e82d-4216-8797-7583428a0c13 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:25.340496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4773-e82d-4216-8797-7583428a0c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:25.367904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-457f4773-e82d-4216-8797-7583428a0c13 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:25.369150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-457f4773-e82d-4216-8797-7583428a0c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:25.378299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 781/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:25.632239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f1f5-25a0-4c99-8e3f-a03d8922c3bc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:25.634351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e309f1f5-25a0-4c99-8e3f-a03d8922c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:25.701110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f1f5-25a0-4c99-8e3f-a03d8922c3bc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:25.705362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec240b53-1a62-41f7-b47c-146c6fe1b3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:25.706209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240b53-1a62-41f7-b47c-146c6fe1b3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:25.706493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240b53-1a62-41f7-b47c-146c6fe1b3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:25.706769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240b53-1a62-41f7-b47c-146c6fe1b3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:25.716089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec240b53-1a62-41f7-b47c-146c6fe1b3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:25.717555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec240b53-1a62-41f7-b47c-146c6fe1b3f0 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:25.727055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 753/1534] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:08:28.134563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e7cf-4e0e-4fc9-8553-288dc42a48b4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:28.135409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e7cf-4e0e-4fc9-8553-288dc42a48b4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:28.135409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e7cf-4e0e-4fc9-8553-288dc42a48b4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:28.138231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 782/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 4 06:08:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:28.145847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d6ac2-52be-4072-b84f-d1dfe78bf83c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:28.146328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d6ac2-52be-4072-b84f-d1dfe78bf83c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:28.146422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d6ac2-52be-4072-b84f-d1dfe78bf83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:28.174752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f68d6ac2-52be-4072-b84f-d1dfe78bf83c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:28.175960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f68d6ac2-52be-4072-b84f-d1dfe78bf83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:28.185227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 754/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 4 06:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:28.443685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236a62e-4dc6-4c79-9374-8faa8c2076b1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:28.444166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236a62e-4dc6-4c79-9374-8faa8c2076b1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:28.444632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236a62e-4dc6-4c79-9374-8faa8c2076b1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:28.447663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 783/1537] 10.222.0.30 () {54 vars in 962 bytes} [Mon Apr 4 06:08:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:08:28.455622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff8e7-3728-48cd-8c48-172d68f7db07 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:28.455936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff8e7-3728-48cd-8c48-172d68f7db07 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:28.456179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eff8e7-3728-48cd-8c48-172d68f7db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:28.477577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c9eff8e7-3728-48cd-8c48-172d68f7db07 None None] MFA Rules not processed for user `7f0640518ddc4893b20b6d79c80c21ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:08:28.478779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c9eff8e7-3728-48cd-8c48-172d68f7db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:08:28.485546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 755/1538] 10.222.0.30 () {58 vars in 1059 bytes} [Mon Apr 4 06:08:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:08:28.495409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236a62e-4dc6-4c79-9374-8faa8c2076b1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:08:28.507735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236a62e-4dc6-4c79-9374-8faa8c2076b1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:08:28.512014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da98b8-32ef-4954-923d-aa7d80829473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:08:28.512644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da98b8-32ef-4954-923d-aa7d80829473 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:08:28.512932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da98b8-32ef-4954-923d-aa7d80829473 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:08:28.513218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da98b8-32ef-4954-923d-aa7d80829473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:08:28.523207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da98b8-32ef-4954-923d-aa7d80829473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:08:28.524647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da98b8-32ef-4954-923d-aa7d80829473 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:08:28.534039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 784/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:55.968695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c875-9af7-420f-abdf-2c100afa5422 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:55.970018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c875-9af7-420f-abdf-2c100afa5422 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:55.970519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c875-9af7-420f-abdf-2c100afa5422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.002604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4174c875-9af7-420f-abdf-2c100afa5422 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.004190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4174c875-9af7-420f-abdf-2c100afa5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.016786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 756/1540] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.021487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.022475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.023399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.027310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909656-202c-4e75-8cd8-9f308c61c7d1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.027850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909656-202c-4e75-8cd8-9f308c61c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.028335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909656-202c-4e75-8cd8-9f308c61c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.051710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-14909656-202c-4e75-8cd8-9f308c61c7d1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.052157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.053415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.054204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-14909656-202c-4e75-8cd8-9f308c61c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.068351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 785/1541] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.071794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 757/1542] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.076861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.083468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.084500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.085024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.091621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1f4f2-4c86-4b61-a106-d27aa46cace8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.101124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.101742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.102025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.102299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.103040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.103345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.104426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:09:56.104426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:09:56.104426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:09:56.105352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4e27c-f1cc-4a8b-a919-e50ed15c534c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.123149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 786/1543] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.123623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.123910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.124190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.127950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.129811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.164194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.166994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 758/1544] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.168150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.174801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.186784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 787/1545] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.188505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.201612 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256d8b-abd1-4dfd-bf9a-fec80dd13085 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.216781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d13f-8a5a-42db-9c33-c079fb716a63 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.223583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.225668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.226002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.226360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.226655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.226939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.227360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.227622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.228224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.228661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:09:56.228661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:09:56.228661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:09:56.229646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.229883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.230367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.232202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec99ae-7eb4-47d0-a7b8-7863f1fba96d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.248070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 788/1546] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.249969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f32fe-9fd2-4d65-8f9b-bcab212d9b81 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.250617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f32fe-9fd2-4d65-8f9b-bcab212d9b81 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.251258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f32fe-9fd2-4d65-8f9b-bcab212d9b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.272181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-219f32fe-9fd2-4d65-8f9b-bcab212d9b81 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.274046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-219f32fe-9fd2-4d65-8f9b-bcab212d9b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.284736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 789/1547] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.287200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7de42-9af2-498d-8dd7-06b9c13ddc8a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.287624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7de42-9af2-498d-8dd7-06b9c13ddc8a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.288002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7de42-9af2-498d-8dd7-06b9c13ddc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.309478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 759/1548] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:56.312682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.336004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-74a7de42-9af2-498d-8dd7-06b9c13ddc8a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.337408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-74a7de42-9af2-498d-8dd7-06b9c13ddc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.397699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dee628-38c0-41fd-9dda-93b96db2ba8d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.402970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.403634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.403922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.404198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.404971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.407112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.413385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 790/1549] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.418774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a80f3-1da3-4d04-b556-fa9518d01985 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.419270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a80f3-1da3-4d04-b556-fa9518d01985 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.419702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a80f3-1da3-4d04-b556-fa9518d01985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.443332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 760/1550] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:56.443332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.443671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ae8a80f3-1da3-4d04-b556-fa9518d01985 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.444315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae8a80f3-1da3-4d04-b556-fa9518d01985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.510650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 791/1551] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.510650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac037ee-641d-455f-aea6-2aa291b1e9cf None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.510650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac037ee-641d-455f-aea6-2aa291b1e9cf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.510650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac037ee-641d-455f-aea6-2aa291b1e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.513830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da20ef-0c9a-4924-a852-06505b4ae75a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.519532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b9c7c-a28a-42ff-83f3-8e768c2c90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.519532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9c7c-a28a-42ff-83f3-8e768c2c90e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.519951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9c7c-a28a-42ff-83f3-8e768c2c90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.520233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9c7c-a28a-42ff-83f3-8e768c2c90e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.521202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9c7c-a28a-42ff-83f3-8e768c2c90e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.523299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9c7c-a28a-42ff-83f3-8e768c2c90e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.538039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eac037ee-641d-455f-aea6-2aa291b1e9cf None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.539441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eac037ee-641d-455f-aea6-2aa291b1e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.544014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 761/1552] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:56.545397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.545682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.545961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.547844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 792/1553] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.549427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.549758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.550023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.564519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.565767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.567666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.568868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.573722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 762/1554] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.574495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.577149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 793/1555] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.578189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.588583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ceefc-633c-4dde-b9da-9aa484477e34 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.588813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1153-12c6-4e43-982c-581b8a9de06b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.593197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.593345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.593876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.594001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.594326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.594484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.594616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.594766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.595279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.595546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.595741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.596799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:09:56.596799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:09:56.596799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:09:56.597262 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.598127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1356-7a0e-474b-9d3c-0713885d3714 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.610154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 763/1556] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.611416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.622036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 794/1557] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:56.622229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c1e5e-588b-4abb-9941-9948c2192c30 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.622666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a15f-f006-412b-b5d6-f91354a510c3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.622951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a15f-f006-412b-b5d6-f91354a510c3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.623224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a15f-f006-412b-b5d6-f91354a510c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.629090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.629909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.630043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.630280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.631027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.631329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.632922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.642630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d5b9a15f-f006-412b-b5d6-f91354a510c3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.643848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5b9a15f-f006-412b-b5d6-f91354a510c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.645432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 764/1558] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.646219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.655405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7a37-c57e-498f-be3c-34dc537337a1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.659620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 795/1559] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.660817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca83c-084d-4e61-9a84-3aa704cec61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.660976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4cad-c71d-4a59-b992-4ff55b1b8c6f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.661180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4cad-c71d-4a59-b992-4ff55b1b8c6f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.661454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4cad-c71d-4a59-b992-4ff55b1b8c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.661567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca83c-084d-4e61-9a84-3aa704cec61a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.661759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca83c-084d-4e61-9a84-3aa704cec61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.662037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca83c-084d-4e61-9a84-3aa704cec61a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.662746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca83c-084d-4e61-9a84-3aa704cec61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.664332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca83c-084d-4e61-9a84-3aa704cec61a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.675555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 765/1560] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:56.676581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.677061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.677186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.679738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-71ed4cad-c71d-4a59-b992-4ff55b1b8c6f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.680935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-71ed4cad-c71d-4a59-b992-4ff55b1b8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.689528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 796/1561] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.690768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.691061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.691323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.696847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.698090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.707039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 766/1562] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.707658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.709616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.710787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.717326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70298d18-346f-4c96-9c08-603ac6753718 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.718854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 797/1563] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.720409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.724758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5bbc-f0cc-400f-86b3-8cfd35d74a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.725458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5bbc-f0cc-400f-86b3-8cfd35d74a90 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.725739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5bbc-f0cc-400f-86b3-8cfd35d74a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.726016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5bbc-f0cc-400f-86b3-8cfd35d74a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.726720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf5bbc-f0cc-400f-86b3-8cfd35d74a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.728836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf5bbc-f0cc-400f-86b3-8cfd35d74a90 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.731972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6faa74-32f6-47b8-9cbf-c7ae1781aa3d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.736843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.737528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.737812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.738080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.738802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.740425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.751936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 798/1564] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:56.752599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.757620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 767/1565] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:56.758918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.759259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.759602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.763378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792ec1-fa8f-4690-975b-d125a62fab20 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.777790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:56.778994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:56.819990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.820654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.820959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.821236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.821943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.823831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.838300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 768/1566] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:56.839341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.849239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41585cde-cfdb-4d41-bf5c-ba538583f0f4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.853800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.854465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.854745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.855021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.855137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 799/1567] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:56.856045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.858584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.860475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.871274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 769/1568] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:56.871949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.882280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac17de-e71a-4804-9dc6-17e09ec89ced admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.922283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72474d40-e1d8-47b3-becd-05d77194a60e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.927160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.927823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.928103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.928375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.929125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.929433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.931051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.943303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 800/1569] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.944241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.946187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.946855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.947132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.947411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.948127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.948427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.950154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.955286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b78e57-1dd0-4647-b1c3-3d9b6a4a3a51 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.960650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.961416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.961697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.961968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.962078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 770/1570] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.962685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:56.962836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.962987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.964600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.972274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104ed35-b38b-41d0-8975-cf97dc335f21 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.977153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.984221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 801/1571] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:56.984390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.984390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.984390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.984662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.984793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.984793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:56.987845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e592-5353-49c8-920f-2caee8c74e71 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:56.991436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 771/1572] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:56.992229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:56.992418 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:56.993111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:56.993394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:56.993666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:56.994649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:56.996671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.004039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c140654-3999-4e3c-a72d-d26cc2a67bb8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.009025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.009784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.010101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.010408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.011239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:09:57.011585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.013247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.017753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 802/1573] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:56 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.021708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.032636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 772/1574] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:09:57.032636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.032891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27287dc-f1d6-43c3-919a-08de6f5cd323 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.037246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.037909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.038191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.038459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.039137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.041064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.041793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd944b7f-3fbd-410e-9111-889a431c46d6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.046266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.047192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.047495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.047784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] PATH_INFO: `/v3/projects/75aa157b3e0f445d9652d5d3acfc287c/users/5aef2a8bb6154dfc842673c80c912359/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.065128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 803/1575] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.065327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aa157b3e0f445d9652d5d3acfc287c, user_id=5aef2a8bb6154dfc842673c80c912359, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.065447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.065562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:09:57.065562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:09:57.065562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:09:57.066121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.073034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99585d27-c5fe-4f6b-85a4-5b16ee7ccce6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.077841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.078792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.079082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.079359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.080048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.080144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 773/1576] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:57 2022] PUT /identity/v3/projects/75aa157b3e0f445d9652d5d3acfc287c/users/5aef2a8bb6154dfc842673c80c912359/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:57.080888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.081988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.110223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 804/1577] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.111063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.144305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de791c-4600-4b76-9bfa-dc7e74d4b560 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.182381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7eae9-9229-4c07-a629-8a78d78186b4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.187177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.187869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.188158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.188425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.189137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.191083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.200208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.200866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.201161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.201431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.202108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.204150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.217626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 805/1578] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.218420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.234119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 774/1579] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.235093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.276730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f20ed-5c64-4b18-bec0-6758bfe23259 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.296380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe62b96-cecf-4ad3-b26d-f9bb8304fd5e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.301159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.301828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.302102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.302340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.303096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.305024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.314879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 775/1580] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.317775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.327862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc0ef5-77b5-4065-8052-b0fec30b4842 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.331675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.332562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.332844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.333028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b473a1-c4f8-424a-adca-3509eaa1c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.333241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] PATH_INFO: `/v3/projects/f97d1852193346c6916d9747f0c3b84f/users/6b909365ef3640f3b15ec4ca0e7d6d33/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.333561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b473a1-c4f8-424a-adca-3509eaa1c998 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.333839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b473a1-c4f8-424a-adca-3509eaa1c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.334107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b473a1-c4f8-424a-adca-3509eaa1c998 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.334794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b473a1-c4f8-424a-adca-3509eaa1c998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.336722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b473a1-c4f8-424a-adca-3509eaa1c998 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.347530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97d1852193346c6916d9747f0c3b84f, user_id=6b909365ef3640f3b15ec4ca0e7d6d33, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.350200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.364137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 806/1581] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:57 2022] PUT /identity/v3/projects/f97d1852193346c6916d9747f0c3b84f/users/6b909365ef3640f3b15ec4ca0e7d6d33/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:57.364504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 776/1582] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.366082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.366563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.367007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.368423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.393014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] MFA Rules not processed for user `5aef2a8bb6154dfc842673c80c912359`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:57.394350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:57.428277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738e773-1416-41ac-9130-a310a64e0b68 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.459008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 777/1583] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:57.459859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.482328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.482999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.483277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.483567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.484284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.485924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.496212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 807/1584] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.497372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.506800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f429e0-ed05-44e5-a8ec-081a47f18839 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.511891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.512572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.512853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.513166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.513857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.516134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.519426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635316df-4904-4b8f-a6e3-cc1dfc0a2a35 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.523923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.524520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.524800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.525101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.525811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.527705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.536785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 808/1585] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/users => generated 302 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.537660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.547677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b322-dbd4-4c58-9be4-de3ba9a3a6cb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.552171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.552820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.552952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 778/1586] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.553126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.553395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.553832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.554065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.555945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.568058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85adfc-ca8a-4d3b-881c-8b486f3832c2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.573261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc9dc8-a197-47c7-8b29-225292cb5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.573986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9dc8-a197-47c7-8b29-225292cb5d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.574269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9dc8-a197-47c7-8b29-225292cb5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.574543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9dc8-a197-47c7-8b29-225292cb5d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.575290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9dc8-a197-47c7-8b29-225292cb5d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.576874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9dc8-a197-47c7-8b29-225292cb5d43 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.577905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 809/1587] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.578590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.588037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2afd3-9f09-47f3-806b-3ae85d1fc62a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.590501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 779/1588] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.592012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.592304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.592575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.592815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.593487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.593961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.594143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.595147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.597086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.610783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:57.612079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:57.618810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 810/1589] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.619675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.623545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 780/1590] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:57.623545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.630683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954313b-832f-440f-ac17-ee53a0735581 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.634425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8384c-49fa-4ca3-a25c-7b3398fef27f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.635634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.636292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.636571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.636843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.637599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.639480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.639648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.640659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.640994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.641259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.642083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.643670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.653815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 781/1591] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.654588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.664741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7e7c-876c-4edc-a439-78d8652c05a4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.667056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 811/1592] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.667873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.669948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.670668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.670951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.671223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.671975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.674169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.687085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 782/1593] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.687085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.696731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de5de2-55d5-459f-8d17-1b948a5fa92d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.727682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0226b2-fce3-46b0-b89f-fd4bcd101ed6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.732443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.733139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.733428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.733686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.734407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.736447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.746111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 812/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.747796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.752869 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.753579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.753877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.754146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.754871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.756517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.757756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93702ed-17b3-47c3-9e57-7c244b8ef8eb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.762470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.763387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.763618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.763895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] PATH_INFO: `/v3/projects/08d7eeffcac04a56b6f1ccf7013b02ae/users/38c1a5c9e61a4077b1db74858903589f/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.767224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 783/1595] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.768028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.777457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17fd35-1eed-4ee7-b28f-41257bb0b26a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.779505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d7eeffcac04a56b6f1ccf7013b02ae, user_id=38c1a5c9e61a4077b1db74858903589f, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.782473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.782594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.783243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.783524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.783770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.784506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.786082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.796117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 813/1596] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:57 2022] PUT /identity/v3/projects/08d7eeffcac04a56b6f1ccf7013b02ae/users/38c1a5c9e61a4077b1db74858903589f/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:57.796987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.798629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 784/1597] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.799476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.811524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661746-ca6c-4fa4-ab0a-145891d8186f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.859265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b9bcc-2988-4de6-93c8-db933111daa4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.863247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.863893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.864177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.864442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.867851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.868850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.869252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.869618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] PATH_INFO: `/v3/projects/eb48c2dfec0b435e978641e49934d2c0/users/8d1c1bb5571f4b5cbde6b417c04ac484/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.873504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.874923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.883634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb48c2dfec0b435e978641e49934d2c0, user_id=8d1c1bb5571f4b5cbde6b417c04ac484, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.884575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 814/1598] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:57.885455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.886460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.895662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df164-1f37-4832-885e-2496ddd43261 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.901787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.902639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.902888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.903207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.903975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.904079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 785/1599] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:57 2022] PUT /identity/v3/projects/eb48c2dfec0b435e978641e49934d2c0/users/8d1c1bb5571f4b5cbde6b417c04ac484/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:57.908430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.908570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.931081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 815/1600] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:57 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:57.932224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:57.943331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1f818-9160-41a9-8eb8-271adc43266c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.968406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca02d2-78b1-4a82-ac70-c9a37d13dd28 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:57.974241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:57.975235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:57.975440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:57.975808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:57.977072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:57.978906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:57.994506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 786/1601] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:57.995630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.004243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.005084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.005570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.005912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.006426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535711-29da-4e18-83fc-9a20004e1280 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.006804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.008465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.012106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0723d-101d-44d6-b6e5-65d38e161c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.012777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0723d-101d-44d6-b6e5-65d38e161c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.013097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0723d-101d-44d6-b6e5-65d38e161c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.013377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0723d-101d-44d6-b6e5-65d38e161c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.014111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0723d-101d-44d6-b6e5-65d38e161c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.016317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0723d-101d-44d6-b6e5-65d38e161c1e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.023984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 816/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:58.023984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.027328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 787/1603] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:58.032114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.032408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.032692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.035185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198738a3-5308-4ad0-8715-a89e0396dc3e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.041011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf1edc-3ac6-4bd7-9470-fa3212d6bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.041914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf1edc-3ac6-4bd7-9470-fa3212d6bca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.042445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf1edc-3ac6-4bd7-9470-fa3212d6bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.042824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf1edc-3ac6-4bd7-9470-fa3212d6bca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.044035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf1edc-3ac6-4bd7-9470-fa3212d6bca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.047146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf1edc-3ac6-4bd7-9470-fa3212d6bca2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.059624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] MFA Rules not processed for user `38c1a5c9e61a4077b1db74858903589f`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:58.064604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.065010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 817/1604] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:58.065010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.065010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.065010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.097732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:58.098998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.108574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 818/1605] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:58.109434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.120931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6ccef-086f-4cef-99b5-77954a96f1da None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.126059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.126922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.127347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.127762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.128722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.130570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.134111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 788/1606] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:58.138160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.147315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 819/1607] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:58.147315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.149352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409745c9-b43d-4ae5-971c-0ccc5f3db17a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.155611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.157004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.157248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360daee-08ed-4006-94ce-4edb35f67ddc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.157370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.157653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] PATH_INFO: `/v3/projects/5ef627744431474292658424c03c177e/users/279ee83b2ab844f88e98d8039a3f54d7/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.163114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.164289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.164665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.165073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] PATH_INFO: `/v3/projects/4c3cf8bdbf3b456480c868d1ffd0a75f/users/5a033fa406b14ff19343065c5a459dd7/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.176833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef627744431474292658424c03c177e, user_id=279ee83b2ab844f88e98d8039a3f54d7, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.180040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.183324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3cf8bdbf3b456480c868d1ffd0a75f, user_id=5a033fa406b14ff19343065c5a459dd7, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.186335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.197846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 789/1608] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:58 2022] PUT /identity/v3/projects/5ef627744431474292658424c03c177e/users/279ee83b2ab844f88e98d8039a3f54d7/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:58.201681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.214904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 820/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:58 2022] PUT /identity/v3/projects/4c3cf8bdbf3b456480c868d1ffd0a75f/users/5a033fa406b14ff19343065c5a459dd7/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:58.216370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.288487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae829a8-3690-47fe-b620-e3db8b196eb9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.290281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0cb5-d97a-4474-b5fd-2a2b50f3113e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.294290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.295093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.295353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.295745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.296454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] PATH_INFO: `/v3/projects/dd1169d547e144beab6ca75e416bc17a/users/e42bfa885f4545a48d39cd0c0faa6ff3/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.298726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.299566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.299566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] PATH_INFO: `/v3/projects/3bf2aa8f9fc74712aac7ec691de75582/users/8b9373968e9c4eca8a038854815796ae/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.317693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1169d547e144beab6ca75e416bc17a, user_id=e42bfa885f4545a48d39cd0c0faa6ff3, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.320624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf2aa8f9fc74712aac7ec691de75582, user_id=8b9373968e9c4eca8a038854815796ae, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.323987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.326094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.342685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 790/1610] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:58 2022] PUT /identity/v3/projects/3bf2aa8f9fc74712aac7ec691de75582/users/8b9373968e9c4eca8a038854815796ae/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:58.343422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.354499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 821/1611] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:58 2022] PUT /identity/v3/projects/dd1169d547e144beab6ca75e416bc17a/users/e42bfa885f4545a48d39cd0c0faa6ff3/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:58.354712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.354844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.406204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf02b-e8ea-4c74-95a9-82101beb382f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.410849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.411583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.411931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.412268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.414972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559aef1-3da0-4032-85a2-1fbdeddd3d83 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.471018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.472508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.483746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc873f7a-4772-4e20-bfd8-a8a1b3c45888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.484006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 822/1612] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:58.484953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.485141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873f7a-4772-4e20-bfd8-a8a1b3c45888 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.485742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873f7a-4772-4e20-bfd8-a8a1b3c45888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.486209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873f7a-4772-4e20-bfd8-a8a1b3c45888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.575607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854bb3a-5673-43b3-b237-898fc4e4a755 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.579272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc873f7a-4772-4e20-bfd8-a8a1b3c45888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.581866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc873f7a-4772-4e20-bfd8-a8a1b3c45888 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.582621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda18b-89d1-4f2f-b489-4ba9b998fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.583724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda18b-89d1-4f2f-b489-4ba9b998fd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.584152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda18b-89d1-4f2f-b489-4ba9b998fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.584573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda18b-89d1-4f2f-b489-4ba9b998fd7e admin admin] PATH_INFO: `/v3/projects/f894da0a405c43938dfecf3d5ad7e51a/users/f31eb91416d64122ba389e2ee8c2ec64/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.595035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 791/1613] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:58.596612 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82591da-ba73-4d05-98dc-7cb745c89a6a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.597345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82591da-ba73-4d05-98dc-7cb745c89a6a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.597848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82591da-ba73-4d05-98dc-7cb745c89a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.608732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda18b-89d1-4f2f-b489-4ba9b998fd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f894da0a405c43938dfecf3d5ad7e51a, user_id=f31eb91416d64122ba389e2ee8c2ec64, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.612570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda18b-89d1-4f2f-b489-4ba9b998fd7e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.619667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c82591da-ba73-4d05-98dc-7cb745c89a6a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:58.621203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c82591da-ba73-4d05-98dc-7cb745c89a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.631990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 792/1614] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:58.633569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7f88-0be8-40d1-b780-37f175f0bd1f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.633857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7f88-0be8-40d1-b780-37f175f0bd1f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.634181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7f88-0be8-40d1-b780-37f175f0bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.640640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 823/1615] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:58 2022] PUT /identity/v3/projects/f894da0a405c43938dfecf3d5ad7e51a/users/f31eb91416d64122ba389e2ee8c2ec64/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:58.644322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.644894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.645588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.657747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8abe7f88-0be8-40d1-b780-37f175f0bd1f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:58.659211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8abe7f88-0be8-40d1-b780-37f175f0bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.668483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:58.671610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.749884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 793/1616] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:58.758593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.759002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.759350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.774649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 824/1617] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:58.776922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.789552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ccc6f-b3a6-41fc-b945-16104d5db851 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.796122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.797224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.797539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.798546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.799563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.801760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.821513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 825/1618] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:58.823514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.824766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] MFA Rules not processed for user `e42bfa885f4545a48d39cd0c0faa6ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:58.826372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:58.918777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85275ee-1330-4413-94b2-e6bf32c52788 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.926152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.928955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 794/1619] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:58.929089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.929089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.929089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.935588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.944744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.947739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.949092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce733a3-4a23-47a9-b25e-b25c4674ef2b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.954020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.954917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.955378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:58.955880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:58.967383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:58.969422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:58.978568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 826/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:58.981128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 795/1621] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:58.981942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.982635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:58.992835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e7404-ed51-4ae6-8f89-35e8db2a476e service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:58.998019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:58.999256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:58.999733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.000234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] PATH_INFO: `/v3/projects/f894da0a405c43938dfecf3d5ad7e51a/users/f31eb91416d64122ba389e2ee8c2ec64/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.002858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f894da0a405c43938dfecf3d5ad7e51a, user_id=f31eb91416d64122ba389e2ee8c2ec64, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.005982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.006254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546ef18-6434-4803-9955-7e85cfc9d2a9 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.015461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9752b1f-fb04-4a06-9fd0-1106f5c63d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.019850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 796/1622] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:58 2022] PUT /identity/v3/projects/f894da0a405c43938dfecf3d5ad7e51a/users/f31eb91416d64122ba389e2ee8c2ec64/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:59.021055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.021561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9752b1f-fb04-4a06-9fd0-1106f5c63d48 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.023971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9752b1f-fb04-4a06-9fd0-1106f5c63d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.024256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9752b1f-fb04-4a06-9fd0-1106f5c63d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.050559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9752b1f-fb04-4a06-9fd0-1106f5c63d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.056579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9752b1f-fb04-4a06-9fd0-1106f5c63d48 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.088006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 827/1623] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:59.092230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.092753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.093219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.093626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085bc5-caec-4607-bc6c-54a9b473ed6e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.099203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.100158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.100515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.100861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.101702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.103772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.140491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 797/1624] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:09:59 2022] POST /identity/v3/projects => generated 359 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:59.141577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.178808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] MFA Rules not processed for user `f31eb91416d64122ba389e2ee8c2ec64`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:59.181228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:59.211857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad92413-3c2b-45eb-a077-a5d482596309 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.216779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.217537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.217867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.218143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.218841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.220945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.258417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 798/1625] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:09:59 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:09:59.259364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.282680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 828/1626] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:59.284126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f856e9-0fb3-476f-9557-d974f7f70057 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.291417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.297050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.300230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.302259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.302772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.305321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.309422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.335157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 799/1627] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:59.338893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.366113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910248-bc8f-41b6-8ba7-e7aed7c080a5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.371279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca0647-6270-4156-acc8-3b497551b6bf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.372112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.373211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.373633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.374051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.380161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.381619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.382251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.383023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] PATH_INFO: `/v3/projects/12746965282243429d437f8757a84504/users/dd5dadfbef484a6c968f932528e98c94/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.402548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.405584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.409450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12746965282243429d437f8757a84504, user_id=dd5dadfbef484a6c968f932528e98c94, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.419094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.441570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 829/1628] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:09:59.465680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 800/1629] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:59 2022] PUT /identity/v3/projects/12746965282243429d437f8757a84504/users/dd5dadfbef484a6c968f932528e98c94/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:59.469028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.484045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9851-fc36-4603-b0ac-c29d342a30ff service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.569786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d37f-8288-4cbe-bf69-57439b352404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.570510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d37f-8288-4cbe-bf69-57439b352404 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.570778 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d37f-8288-4cbe-bf69-57439b352404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.571053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d37f-8288-4cbe-bf69-57439b352404 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.571798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d37f-8288-4cbe-bf69-57439b352404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.573447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d37f-8288-4cbe-bf69-57439b352404 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.599415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 830/1630] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:09:59.600311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.624589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278baa5-05c9-470a-a589-72c1ecd78943 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.637080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.638965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.640165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.640666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] PATH_INFO: `/v3/projects/12746965282243429d437f8757a84504/users/dd5dadfbef484a6c968f932528e98c94/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.645856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12746965282243429d437f8757a84504, user_id=dd5dadfbef484a6c968f932528e98c94, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.652378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.689281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 801/1631] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:09:59 2022] PUT /identity/v3/projects/12746965282243429d437f8757a84504/users/dd5dadfbef484a6c968f932528e98c94/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:09:59.691176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.691467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.692144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.772330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] MFA Rules not processed for user `dd5dadfbef484a6c968f932528e98c94`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:09:59.774911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:09:59.802230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:09:59.917798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e42868-63a2-49af-b52b-c04bc936586f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:09:59.931258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:09:59.932344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:09:59.932990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:09:59.932990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] PATH_INFO: `/v3/users/5aef2a8bb6154dfc842673c80c912359` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:09:59.934918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aef2a8bb6154dfc842673c80c912359)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:09:59.935957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:09:59.935957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: warnings.warn(msg) Apr 04 06:09:59.935957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: Apr 04 06:09:59.939268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:09:59.942512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 831/1632] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:09:59 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:09:59.954728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:00.067082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b55d3-8e66-4a69-bedf-40b36ceac702 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:00.076692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3ddaf-77a1-4937-bb13-1da6c64654f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:00.077397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ddaf-77a1-4937-bb13-1da6c64654f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:00.078315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ddaf-77a1-4937-bb13-1da6c64654f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:00.078627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ddaf-77a1-4937-bb13-1da6c64654f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:00.079153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aef2a8bb6154dfc842673c80c912359'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:00.091035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3ddaf-77a1-4937-bb13-1da6c64654f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:00.093847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3ddaf-77a1-4937-bb13-1da6c64654f8 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:00.098693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aef2a8bb6154dfc842673c80c912359'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:00.111006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 832/1633] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:09:59 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:00.111960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aef2a8bb6154dfc842673c80c912359'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:00.112750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aef2a8bb6154dfc842673c80c912359'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:00.113542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aef2a8bb6154dfc842673c80c912359'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:00.152730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 802/1634] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:09:59 2022] DELETE /identity/v3/users/5aef2a8bb6154dfc842673c80c912359 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:00.159090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:00.159090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:00.159090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:00.191379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:00.191379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:00.350139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 833/1635] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:00.410217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:00.414510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:00.538273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baa9b4-2c1d-4ed4-8d61-cbbbd8d3eddb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:00.543039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606f91c-6e34-40a7-9ae6-b2c0eb6b124b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:00.543907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f91c-6e34-40a7-9ae6-b2c0eb6b124b service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:00.544215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f91c-6e34-40a7-9ae6-b2c0eb6b124b service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:00.544753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f91c-6e34-40a7-9ae6-b2c0eb6b124b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:00.558694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f91c-6e34-40a7-9ae6-b2c0eb6b124b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:00.561132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f91c-6e34-40a7-9ae6-b2c0eb6b124b service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:00.608036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 803/1636] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:00.908329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:00.909916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:00.924791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a6f8-89f8-454f-adda-56b94747665c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:00.939238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:00.940797 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:00.941338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:00.942109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] PATH_INFO: `/v3/users/e42bfa885f4545a48d39cd0c0faa6ff3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:00.944210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42bfa885f4545a48d39cd0c0faa6ff3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:00.947502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:01.036130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42bfa885f4545a48d39cd0c0faa6ff3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:01.064619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42bfa885f4545a48d39cd0c0faa6ff3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:01.084283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42bfa885f4545a48d39cd0c0faa6ff3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:01.090279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee053-2900-48d7-8a2e-63862e04a51f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.091221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee053-2900-48d7-8a2e-63862e04a51f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.091221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee053-2900-48d7-8a2e-63862e04a51f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.093256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 804/1637] 10.222.0.30 () {54 vars in 960 bytes} [Mon Apr 4 06:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 06:10:01.100265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42bfa885f4545a48d39cd0c0faa6ff3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:01.101422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ff4368aa-af0f-4430-9845-065fb3f1ca17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42bfa885f4545a48d39cd0c0faa6ff3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:01.104546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50b4f-bf6c-44ff-afe5-e39fbfccb702 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.105096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50b4f-bf6c-44ff-afe5-e39fbfccb702 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.105480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50b4f-bf6c-44ff-afe5-e39fbfccb702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.131599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 834/1638] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:00 2022] DELETE /identity/v3/users/e42bfa885f4545a48d39cd0c0faa6ff3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:01.136826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.137138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.137466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.146922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-84c50b4f-bf6c-44ff-afe5-e39fbfccb702 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:01.149314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-84c50b4f-bf6c-44ff-afe5-e39fbfccb702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.193641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:01.194920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.241504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 805/1639] 10.222.0.30 () {58 vars in 1057 bytes} [Mon Apr 4 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:01.248482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2691-b75e-4f0a-b5b4-ee1210a8f4cb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.248870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2691-b75e-4f0a-b5b4-ee1210a8f4cb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.249234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2691-b75e-4f0a-b5b4-ee1210a8f4cb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.255408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 806/1640] 10.222.0.30 () {54 vars in 912 bytes} [Mon Apr 4 06:10:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:01.259881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.260664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.262008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.309466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:01.310882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.327975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 807/1641] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:01.342895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:01.345637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.373288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 835/1642] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:01.399852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:01.402023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.487632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd31f1f-de43-410b-853d-3337d0bda6d8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:01.504851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57b3ef-80c6-4a30-aafd-e5b21fbab161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:01.505661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57b3ef-80c6-4a30-aafd-e5b21fbab161 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.506011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57b3ef-80c6-4a30-aafd-e5b21fbab161 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.506720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57b3ef-80c6-4a30-aafd-e5b21fbab161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.556594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57b3ef-80c6-4a30-aafd-e5b21fbab161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:01.558555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57b3ef-80c6-4a30-aafd-e5b21fbab161 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:01.565926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8357-d188-4692-98b9-b3f5bca5898c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:01.579652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 808/1643] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:01.581321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.581608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.581886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.583336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:01.584177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.584537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.584883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.609540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:01.611525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:01.630837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 836/1644] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:01.635596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] MFA Rules not processed for user `279ee83b2ab844f88e98d8039a3f54d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:01.637869 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.831351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 809/1645] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:01.835947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:01.837747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:01.866655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e54d-3925-441c-b5dc-0abc0dca5bf3 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:01.876435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:01.877534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:01.878031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:01.878497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:01.879423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:01.882140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:01.939018 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 837/1646] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:01 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:01.943718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:01.959977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85065c-08cd-4363-b591-79f5c7347962 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:02.074451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:02.081193 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:02.081626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:02.081932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:02.083026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:02.085282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:02.120768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 810/1647] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:01 2022] POST /identity/v3/users => generated 308 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:02.125268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:02.159585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0150862-9c29-4fd1-a281-4261c0e39e75 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:02.168658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:02.169590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:02.170012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:02.170381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:02.171227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:02.173287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:02.191253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 838/1648] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:02.194788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:02.211945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05ef88-45be-48da-a083-b5d346290204 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:02.218728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:02.220086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:02.220566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:02.220845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] PATH_INFO: `/v3/projects/5888d0d9a92b42af93c3a67af5022c48/users/06b4b3a50efd43b4969e6545888f94d5/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:02.243303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5888d0d9a92b42af93c3a67af5022c48, user_id=06b4b3a50efd43b4969e6545888f94d5, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:02.246145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:02.274153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 811/1649] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:02 2022] PUT /identity/v3/projects/5888d0d9a92b42af93c3a67af5022c48/users/06b4b3a50efd43b4969e6545888f94d5/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:02.275455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:02.290504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c666-885b-42e8-9e53-a49ad48cd774 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:02.379131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:02.379825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:02.380703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:02.381323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:02.382940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:02.384550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:02.416682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 839/1650] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:02.418121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:02.447223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c214ee1-ed6f-46a7-aa62-3c011ca43533 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:02.463206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:02.467065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:02.467339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:02.468492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] PATH_INFO: `/v3/projects/5888d0d9a92b42af93c3a67af5022c48/users/06b4b3a50efd43b4969e6545888f94d5/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:02.473144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5888d0d9a92b42af93c3a67af5022c48, user_id=06b4b3a50efd43b4969e6545888f94d5, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:02.481121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:02.519263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 812/1651] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:02 2022] PUT /identity/v3/projects/5888d0d9a92b42af93c3a67af5022c48/users/06b4b3a50efd43b4969e6545888f94d5/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:02.731066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:02.733325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:02.757781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820aef-266f-4253-b83b-f3c16bcfd04f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:02.895536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:02.899640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:02.899967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:02.900278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] PATH_INFO: `/v3/projects/dd1169d547e144beab6ca75e416bc17a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:02.901900 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1169d547e144beab6ca75e416bc17a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:02.903087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 04 06:10:02.903087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: warnings.warn(msg) Apr 04 06:10:02.903087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: Apr 04 06:10:02.904435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:03.000739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:03.003089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:03.016626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1169d547e144beab6ca75e416bc17a', 'request_id': 'req-04595b32-2624-44df-a896-36a3bf9f7156'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.033119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1169d547e144beab6ca75e416bc17a', 'request_id': 'req-04595b32-2624-44df-a896-36a3bf9f7156'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.033365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffa17-e987-47f1-97bd-52137782d46c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:03.057678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1169d547e144beab6ca75e416bc17a', 'request_id': 'req-04595b32-2624-44df-a896-36a3bf9f7156'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.118978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] The token cache is being invalidate because project dd1169d547e144beab6ca75e416bc17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:03.119203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.119993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.122131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 840/1652] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:02 2022] DELETE /identity/v3/projects/dd1169d547e144beab6ca75e416bc17a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:03.126361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:03.128714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:03.190910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:03.192504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:03.192997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:03.193674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] PATH_INFO: `/v3/projects/75aa157b3e0f445d9652d5d3acfc287c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:03.195247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75aa157b3e0f445d9652d5d3acfc287c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:03.199090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:03.282190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595b32-2624-44df-a896-36a3bf9f7156 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:03.294766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:03.296743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:03.298429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:03.298718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] PATH_INFO: `/v3/users/dd5dadfbef484a6c968f932528e98c94` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:03.303432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5dadfbef484a6c968f932528e98c94)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:03.308944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:03.344970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75aa157b3e0f445d9652d5d3acfc287c', 'request_id': 'req-7919976d-5544-435d-9d98-7de098b6ab96'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.370288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75aa157b3e0f445d9652d5d3acfc287c', 'request_id': 'req-7919976d-5544-435d-9d98-7de098b6ab96'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.385545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75aa157b3e0f445d9652d5d3acfc287c', 'request_id': 'req-7919976d-5544-435d-9d98-7de098b6ab96'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.427041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] The token cache is being invalidate because project 75aa157b3e0f445d9652d5d3acfc287c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:03.429808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.430910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5dadfbef484a6c968f932528e98c94'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.432332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7919976d-5544-435d-9d98-7de098b6ab96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.439491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 813/1653] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:02 2022] DELETE /identity/v3/projects/75aa157b3e0f445d9652d5d3acfc287c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:03.441258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dbe74-43c2-4c06-875e-6c2687770696 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:03.446238 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dbe74-43c2-4c06-875e-6c2687770696 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:03.446753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dbe74-43c2-4c06-875e-6c2687770696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:03.450960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5dadfbef484a6c968f932528e98c94'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.479287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5dadfbef484a6c968f932528e98c94'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.502353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5dadfbef484a6c968f932528e98c94'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.503324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5dadfbef484a6c968f932528e98c94'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.505940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9b6dbe74-43c2-4c06-875e-6c2687770696 None None] MFA Rules not processed for user `5a033fa406b14ff19343065c5a459dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:03.509855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9b6dbe74-43c2-4c06-875e-6c2687770696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:03.516394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 841/1654] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:03 2022] DELETE /identity/v3/users/dd5dadfbef484a6c968f932528e98c94 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:03.516394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:03.520669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:03.740536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 814/1655] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:03.747451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eaf92-d862-49ef-bedb-5905c152d543 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:03.752459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:03.752744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:03.762574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:03.776345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:03.778166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:03.778448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:03.779915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] PATH_INFO: `/v3/users/f31eb91416d64122ba389e2ee8c2ec64` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:03.781591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31eb91416d64122ba389e2ee8c2ec64)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:03.787076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:03.802142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] MFA Rules not processed for user `5a033fa406b14ff19343065c5a459dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:03.806956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:03.823837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 815/1656] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:03.863613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:03.865498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:03.886253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31eb91416d64122ba389e2ee8c2ec64'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.896307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31eb91416d64122ba389e2ee8c2ec64'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.920865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31eb91416d64122ba389e2ee8c2ec64'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.942089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31eb91416d64122ba389e2ee8c2ec64'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.942209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b4671fdd-b40c-4c18-8f90-ee876d0fd131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31eb91416d64122ba389e2ee8c2ec64'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:03.950363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 842/1657] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:03 2022] DELETE /identity/v3/users/f31eb91416d64122ba389e2ee8c2ec64 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:04.010253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277980-a781-4a72-a44c-4a81dfcf4c68 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:04.010840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277980-a781-4a72-a44c-4a81dfcf4c68 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:04.011137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d277980-a781-4a72-a44c-4a81dfcf4c68 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:04.013560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 843/1658] 10.222.0.30 () {54 vars in 960 bytes} [Mon Apr 4 06:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 06:10:04.021770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5e848-0b8a-4469-aa99-8c175154ae11 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:04.022178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5e848-0b8a-4469-aa99-8c175154ae11 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:04.022817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5e848-0b8a-4469-aa99-8c175154ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:04.024062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d6a17-eb44-406c-80ab-fd9f7ba3ccee None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:04.074654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6fc5e848-0b8a-4469-aa99-8c175154ae11 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:04.075891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6fc5e848-0b8a-4469-aa99-8c175154ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:04.107851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:04.108614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:04.108893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:04.109235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:04.111166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:04.162638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 844/1659] 10.222.0.30 () {58 vars in 1057 bytes} [Mon Apr 4 06:10:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:04.168998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9c665-d5db-4d47-9006-76e17e532f94 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:04.169339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9c665-d5db-4d47-9006-76e17e532f94 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:04.169664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9c665-d5db-4d47-9006-76e17e532f94 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:04.172748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 845/1660] 10.222.0.30 () {54 vars in 912 bytes} [Mon Apr 4 06:10:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 04 06:10:04.179371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:04.180064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:04.180064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:04.207408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:04.211063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:04.231055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:04.232383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:04.239396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 816/1661] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:04.255740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 846/1662] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:10:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:04.274371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:04.278718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:04.411989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dda719-d051-4a1d-93b9-9e16fb7fc9a1 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:04.419559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a56d3c-8e38-489f-a05a-6c7d6317f5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:04.420374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56d3c-8e38-489f-a05a-6c7d6317f5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:04.420760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56d3c-8e38-489f-a05a-6c7d6317f5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:04.421639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a56d3c-8e38-489f-a05a-6c7d6317f5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:04.438341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a56d3c-8e38-489f-a05a-6c7d6317f5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:04.440087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a56d3c-8e38-489f-a05a-6c7d6317f5b0 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:04.455165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 817/1663] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:05.337704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:05.341465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:05.519546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0497b74-8d06-4563-86e3-3b6b6547399e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:05.536992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:05.538025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:05.538274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:05.538565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] PATH_INFO: `/v3/projects/12746965282243429d437f8757a84504` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:05.543020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12746965282243429d437f8757a84504)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:05.546810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:05.657886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12746965282243429d437f8757a84504', 'request_id': 'req-f6375bd1-4d0e-46db-8274-d6d58cb73c09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:05.683642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12746965282243429d437f8757a84504', 'request_id': 'req-f6375bd1-4d0e-46db-8274-d6d58cb73c09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:05.691516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12746965282243429d437f8757a84504', 'request_id': 'req-f6375bd1-4d0e-46db-8274-d6d58cb73c09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:05.714280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] The token cache is being invalidate because project 12746965282243429d437f8757a84504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:05.714568 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:05.717598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f6375bd1-4d0e-46db-8274-d6d58cb73c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:05.720197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 847/1664] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:05 2022] DELETE /identity/v3/projects/12746965282243429d437f8757a84504 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:05.726156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93cfdb-2e8d-4a9c-bff5-0fdec683f5ca None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:05.726718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93cfdb-2e8d-4a9c-bff5-0fdec683f5ca None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:05.726718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93cfdb-2e8d-4a9c-bff5-0fdec683f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:05.758830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8c93cfdb-2e8d-4a9c-bff5-0fdec683f5ca None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:05.760322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8c93cfdb-2e8d-4a9c-bff5-0fdec683f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:05.772500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d0ee-b1b7-49f4-8aba-71d7cb30b520 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:05.773081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d0ee-b1b7-49f4-8aba-71d7cb30b520 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:05.775524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d0ee-b1b7-49f4-8aba-71d7cb30b520 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:05.777555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 848/1665] 10.222.0.30 () {54 vars in 912 bytes} [Mon Apr 4 06:10:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:05.783825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:05.784116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:05.784570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:05.894345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] MFA Rules not processed for user `6ada2f7acb1349e38b96dfbda5546101`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:05.896125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:05.965570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 818/1666] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:05.974892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:05.975886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:05.976167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:05.995137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 849/1667] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:10:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 04 06:10:06.043130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:06.045704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:06.056787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.058399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:06.067242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 819/1668] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:06.071476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.074937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12dfed-8c04-4e14-9a33-63e0a9ac81f9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.085995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.086849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.087302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.087672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.102752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd787eab-8cc0-408e-a01a-15eba61f8d0a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.110651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.112679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.119128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.119872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.120153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.120432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.121198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:06.121504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.123149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.138069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 850/1669] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:06.160884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 820/1670] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:06.165768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.187407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72b433-240a-46a9-b801-4eed5d649cb3 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.203469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.204469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.205427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.206281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.207239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.210700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.271051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 851/1671] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:06.274825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.288633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683ca5-c891-4af1-bde8-fc7de7b4c1d1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.462945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.463670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.463949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.464224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.465028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.466969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.523075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 821/1672] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:06 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:06.524537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.547240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faa26a-ffb2-4d14-af60-e5f378196ee8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.567302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.568316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.568766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.569238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.570150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.575176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.616308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.628744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326bd99-1b95-4972-b2b0-9d77bc4e99eb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.629371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 852/1673] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:06.644214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf821b-7574-4cb7-8074-6f90f0e19fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.645277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf821b-7574-4cb7-8074-6f90f0e19fac admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.645738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf821b-7574-4cb7-8074-6f90f0e19fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.646178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf821b-7574-4cb7-8074-6f90f0e19fac admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.647080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf821b-7574-4cb7-8074-6f90f0e19fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.648961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf821b-7574-4cb7-8074-6f90f0e19fac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.705488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 822/1674] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:06.710043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:06.721754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd5719-2b37-4c41-ad3e-3918cc1ab464 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:06.743006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:06.744603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.745476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.746024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] PATH_INFO: `/v3/projects/ec228322d46643e5a590546277283a02/users/b1de23ff5ab84b81b04bdceb4bc8780e/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.796363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec228322d46643e5a590546277283a02, user_id=b1de23ff5ab84b81b04bdceb4bc8780e, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:06.800658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:06.829812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 853/1675] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:06 2022] PUT /identity/v3/projects/ec228322d46643e5a590546277283a02/users/b1de23ff5ab84b81b04bdceb4bc8780e/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:06.842508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:06.846010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:06.846441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:06.890138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] MFA Rules not processed for user `b1de23ff5ab84b81b04bdceb4bc8780e`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:06.891978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:07.006615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:07.008657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:07.067326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 823/1676] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:07.079310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:07.189070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940f07-0ab5-4247-9e9a-e21b00a1f2b0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:07.201817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:07.202937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.203439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.203847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] PATH_INFO: `/v3/projects/f894da0a405c43938dfecf3d5ad7e51a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.209416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f894da0a405c43938dfecf3d5ad7e51a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:07.211828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:07.228223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1535d-ee8e-49bc-a46c-eeee66454834 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:07.252022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:07.252681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.252982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.253258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.253966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:07.255900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:07.320739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f894da0a405c43938dfecf3d5ad7e51a', 'request_id': 'req-4f2358d5-c283-45a3-80f8-7058a9c42535'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:07.341028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f894da0a405c43938dfecf3d5ad7e51a', 'request_id': 'req-4f2358d5-c283-45a3-80f8-7058a9c42535'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:07.352683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f894da0a405c43938dfecf3d5ad7e51a', 'request_id': 'req-4f2358d5-c283-45a3-80f8-7058a9c42535'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:07.358619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 824/1677] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:07 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:07.362723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:07.392481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] The token cache is being invalidate because project f894da0a405c43938dfecf3d5ad7e51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:07.393121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:07.395100 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4f2358d5-c283-45a3-80f8-7058a9c42535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:07.400455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 854/1678] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:07 2022] DELETE /identity/v3/projects/f894da0a405c43938dfecf3d5ad7e51a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:07.406494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91a5dc-8843-4e28-9075-889d60532a95 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.406494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91a5dc-8843-4e28-9075-889d60532a95 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.406494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91a5dc-8843-4e28-9075-889d60532a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.454445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-be91a5dc-8843-4e28-9075-889d60532a95 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:07.456133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-be91a5dc-8843-4e28-9075-889d60532a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:07.524931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b461e2-bd96-401f-81af-33ba02816f72 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:07.551345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:07.552271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.554034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.554333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.555061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:07.566764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:07.621150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 825/1679] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:07 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:07.626507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:07.632444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:07.657903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 855/1680] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:07.666718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d380b9a-7d31-438c-8b2e-987f1a14cf8a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.667014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d380b9a-7d31-438c-8b2e-987f1a14cf8a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.667294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d380b9a-7d31-438c-8b2e-987f1a14cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.680777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7aa8-b7b5-4185-95e8-db9fea4c5802 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:07.697442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:07.698207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.698486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.708398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.709424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:07.711333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:07.712476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7d380b9a-7d31-438c-8b2e-987f1a14cf8a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:07.716653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d380b9a-7d31-438c-8b2e-987f1a14cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:07.732766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 826/1681] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:07.737233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:07.756391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 856/1682] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:07.757808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.758098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.758381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.775342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb6bd-2d9a-40b2-8527-cb1f57aa6ecc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:07.815049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:07.816167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:07.816550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:07.816946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] PATH_INFO: `/v3/projects/8fa17457367742f89f6344830b34dc5f/users/ad4c82bef19147b39c7b42cf30ff9356/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:07.823165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] MFA Rules not processed for user `06b4b3a50efd43b4969e6545888f94d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:07.824409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:07.879867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa17457367742f89f6344830b34dc5f, user_id=ad4c82bef19147b39c7b42cf30ff9356, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:07.884151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:07.930985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 827/1683] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:07 2022] PUT /identity/v3/projects/8fa17457367742f89f6344830b34dc5f/users/ad4c82bef19147b39c7b42cf30ff9356/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:07.932304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:07.993394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 857/1684] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:08.011346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.049462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b695-3439-4468-af8b-503061f1d0c5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.060552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad7b0c-e24f-4e61-9a10-0925eccb764a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.071590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.072354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.072647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.072933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.074334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.084467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.089964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.090676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.090959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.096143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.098636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:08.098957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.115237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.129533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 858/1685] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:08.136053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.144007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 828/1686] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:08.147943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.161557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244ac9-cd6c-4854-ba29-29b89324754b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.167658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad0ee-246e-4ca4-a8c1-d1e42666806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.168335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad0ee-246e-4ca4-a8c1-d1e42666806b admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.168769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad0ee-246e-4ca4-a8c1-d1e42666806b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.169145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad0ee-246e-4ca4-a8c1-d1e42666806b admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.172474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad0ee-246e-4ca4-a8c1-d1e42666806b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.174877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad0ee-246e-4ca4-a8c1-d1e42666806b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.179925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b8348-e0d4-4750-bda0-a9621ae5cbda admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.202252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.205092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.205591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.206420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] PATH_INFO: `/v3/projects/8fa17457367742f89f6344830b34dc5f/users/ad4c82bef19147b39c7b42cf30ff9356/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.212591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa17457367742f89f6344830b34dc5f, user_id=ad4c82bef19147b39c7b42cf30ff9356, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.220444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.249155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 859/1687] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:08 2022] PUT /identity/v3/projects/8fa17457367742f89f6344830b34dc5f/users/ad4c82bef19147b39c7b42cf30ff9356/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:08.251654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 829/1688] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:08.256098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.272001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267a651-fc5d-48f7-93f2-3b582a33b86d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.272509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267a651-fc5d-48f7-93f2-3b582a33b86d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.272845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267a651-fc5d-48f7-93f2-3b582a33b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.314826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9267a651-fc5d-48f7-93f2-3b582a33b86d None None] MFA Rules not processed for user `ad4c82bef19147b39c7b42cf30ff9356`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:08.316577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9267a651-fc5d-48f7-93f2-3b582a33b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:08.379429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9f3d-1e76-4cb4-a754-05048dfec3b0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.481453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 830/1689] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:08.485209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762340e-85a1-4149-90b3-a8d89f4efbe8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.485493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762340e-85a1-4149-90b3-a8d89f4efbe8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.485761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762340e-85a1-4149-90b3-a8d89f4efbe8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.487614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 831/1690] 10.222.0.30 () {54 vars in 960 bytes} [Mon Apr 4 06:10:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:08.494776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762340e-85a1-4149-90b3-a8d89f4efbe8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.499165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a762340e-85a1-4149-90b3-a8d89f4efbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:08.528756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb6e6-2c29-4446-8337-9821eeef04df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.529823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb6e6-2c29-4446-8337-9821eeef04df admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.530294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb6e6-2c29-4446-8337-9821eeef04df admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.530772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb6e6-2c29-4446-8337-9821eeef04df admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.531757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efb6e6-2c29-4446-8337-9821eeef04df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.535644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efb6e6-2c29-4446-8337-9821eeef04df admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.599987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 860/1691] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:08 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:08.602998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.604230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.604660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.618248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762340e-85a1-4149-90b3-a8d89f4efbe8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.630671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.631301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.631579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.631920 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.635136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:08.657472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] MFA Rules not processed for user `2dda594dc09349198b35cff3bc47c0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:08.662001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:08.770689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 861/1692] 10.222.0.30 () {58 vars in 1057 bytes} [Mon Apr 4 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:08.773529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.792282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.795903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.799608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a96713-3caa-42e6-8a1d-1792cd3e20df None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.817915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.818436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.818719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.818993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.819765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.821472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.851833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 832/1693] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:08.860275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.882425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 862/1694] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:08.883565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.884189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f893f-c791-4d82-9e40-f857e6c0cd18 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.897753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.899362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.900410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.901114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.906565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:08.919801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58cee9-dba5-4635-84c2-a6455fed72dc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.930860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986433a-a527-4b60-85f9-9faffbe3cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.931557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986433a-a527-4b60-85f9-9faffbe3cbec admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.931846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986433a-a527-4b60-85f9-9faffbe3cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.932131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986433a-a527-4b60-85f9-9faffbe3cbec admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:08.932853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986433a-a527-4b60-85f9-9faffbe3cbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.936641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986433a-a527-4b60-85f9-9faffbe3cbec admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.945662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:08.949211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:08.964011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 833/1695] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:08.970983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:08.982211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 863/1696] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:08.985594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439799f2-8dd4-4527-9de8-703b7fe504ea service placement] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:08.991159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:08.992875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:08.993297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:08.993680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] PATH_INFO: `/v3/projects/fd29dc9da0894698a79d613713e2ec8b/users/506e8e05abc344798c5f7e5023aa1f4c/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:09.076407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd29dc9da0894698a79d613713e2ec8b, user_id=506e8e05abc344798c5f7e5023aa1f4c, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:09.079303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:09.116360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:09.116733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:09.117184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:09.118596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 834/1697] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:08 2022] PUT /identity/v3/projects/fd29dc9da0894698a79d613713e2ec8b/users/506e8e05abc344798c5f7e5023aa1f4c/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:09.186380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] MFA Rules not processed for user `506e8e05abc344798c5f7e5023aa1f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:09.188100 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:09.435319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 864/1698] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:09.440438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:09.591402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8a72-7a5b-459f-b31c-8251fd29971b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:09.598374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:09.599093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:09.599420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:09.599843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:09.600549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:09.602907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:09.641905 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 835/1699] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:09 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:09.645521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:09.660176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5b69-2e0c-4105-89ba-97f194161064 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:09.882411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f3c11-da62-47b2-83f9-683ace733f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:09.883105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f3c11-da62-47b2-83f9-683ace733f7c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:09.883395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f3c11-da62-47b2-83f9-683ace733f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:09.883670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f3c11-da62-47b2-83f9-683ace733f7c admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:09.884495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f3c11-da62-47b2-83f9-683ace733f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:09.886453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f3c11-da62-47b2-83f9-683ace733f7c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:09.935993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:09.960566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 865/1700] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:09 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:09.968170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188c87-5546-4f11-93b2-81dea28c008f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:09.994512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:09.995109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:09.995395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:09.995671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:09.996415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:09.998099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:10.004888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcec04-65f6-4923-a99b-7d533dd4ecc1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:10.005387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcec04-65f6-4923-a99b-7d533dd4ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:10.005795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcec04-65f6-4923-a99b-7d533dd4ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:10.058436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 836/1701] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:10.059740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:10.083957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4dbcec04-65f6-4923-a99b-7d533dd4ecc1 None None] MFA Rules not processed for user `6b909365ef3640f3b15ec4ca0e7d6d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:10.090424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4dbcec04-65f6-4923-a99b-7d533dd4ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:10.103858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cee85-44fb-49f4-8a75-3ab0a87745cb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:10.120159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:10.121516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:10.122869 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:10.124262 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:10.127334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:10.129816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:10.167196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 837/1702] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:10.168427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:10.192960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acebe5-3dfa-4179-a942-e51c525d1831 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:10.207370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8239867-b07d-487b-8078-194484dfbdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:10.208549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239867-b07d-487b-8078-194484dfbdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:10.209048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239867-b07d-487b-8078-194484dfbdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:10.209511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239867-b07d-487b-8078-194484dfbdbb admin admin] PATH_INFO: `/v3/projects/ae6a3d08b1fb400f8aa939fada9faba4/users/b2f52c39d42446eebf1d08868f786593/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:10.250451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8239867-b07d-487b-8078-194484dfbdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6a3d08b1fb400f8aa939fada9faba4, user_id=b2f52c39d42446eebf1d08868f786593, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:10.253451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8239867-b07d-487b-8078-194484dfbdbb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:10.286808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 866/1703] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:10.289528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:10.289831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:10.291231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:10.298564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 838/1704] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:10 2022] PUT /identity/v3/projects/ae6a3d08b1fb400f8aa939fada9faba4/users/b2f52c39d42446eebf1d08868f786593/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:10.300314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:10.300603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:10.300872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:10.334086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] MFA Rules not processed for user `6b909365ef3640f3b15ec4ca0e7d6d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:10.337906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:10.357225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] MFA Rules not processed for user `b2f52c39d42446eebf1d08868f786593`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:10.358855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:10.533864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 839/1705] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:10.534871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:10.552009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 867/1706] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:10.564800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:10.568935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:10.700084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f120b-6ddb-4003-9755-621ce8927cd6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:10.711372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:10.712430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:10.712717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:10.713010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:10.713722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:10.715779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:10.797246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 840/1707] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:10 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:10.802001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:10.843016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e73e2e-4719-44c2-9c50-2756e038c2d9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.000247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e073ee7-edcd-4a19-af4e-ebe88784e1e5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.013110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:11.013803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.014088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.016083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.017835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:11.025033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:11.059864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:11.061493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.062148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.064111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.093359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 841/1708] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:10 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:11.098863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:11.120068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8db62-502f-44bb-8acc-ab8d07d395f0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.138297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:11.139343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.140722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.141231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.144383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:11.147943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:11.174678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 842/1709] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:11.178379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:11.195077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a1cd8-1dc1-4629-8d76-58573a37619a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.204337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:11.213578 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.213913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.215356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] PATH_INFO: `/v3/projects/9da25b2be3c24d6c85c04115c1e3070d/users/d1cbefdb3b7c491c9ef94a6099417913/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.260916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da25b2be3c24d6c85c04115c1e3070d, user_id=d1cbefdb3b7c491c9ef94a6099417913, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:11.270463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:11.307305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:11.309223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:11.317917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 843/1710] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:11 2022] PUT /identity/v3/projects/9da25b2be3c24d6c85c04115c1e3070d/users/d1cbefdb3b7c491c9ef94a6099417913/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:11.326755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:11.353709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 868/1711] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:11.527714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804cfd-0ce8-42bb-8a49-7700378b6083 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.533480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e540b-a045-4679-8454-0862f704569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:11.534555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e540b-a045-4679-8454-0862f704569e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.535163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e540b-a045-4679-8454-0862f704569e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.535682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e540b-a045-4679-8454-0862f704569e admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.537671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e540b-a045-4679-8454-0862f704569e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:11.540618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e540b-a045-4679-8454-0862f704569e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:11.552611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 844/1712] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:11.556650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:11.570119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cff43-b5f8-40ba-b714-5be2ab523174 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.578174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:11.580553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.581175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.581650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] PATH_INFO: `/v3/projects/9da25b2be3c24d6c85c04115c1e3070d/users/d1cbefdb3b7c491c9ef94a6099417913/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.585468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da25b2be3c24d6c85c04115c1e3070d, user_id=d1cbefdb3b7c491c9ef94a6099417913, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:11.589349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:11.605363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 869/1713] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:11 2022] PUT /identity/v3/projects/9da25b2be3c24d6c85c04115c1e3070d/users/d1cbefdb3b7c491c9ef94a6099417913/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:11.624232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b82cd-8344-4c2f-a135-a04f7bc08fcf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:11.624232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b82cd-8344-4c2f-a135-a04f7bc08fcf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:11.626498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b82cd-8344-4c2f-a135-a04f7bc08fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:11.689260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a30b82cd-8344-4c2f-a135-a04f7bc08fcf None None] MFA Rules not processed for user `d1cbefdb3b7c491c9ef94a6099417913`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:11.690681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a30b82cd-8344-4c2f-a135-a04f7bc08fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:11.886840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 845/1714] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:11.899539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:11.994416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa9f13-aa15-4be9-b44f-a28f5e45fb48 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:11.999345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ffa25-25ff-4b1d-904c-509d25496361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:12.000428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ffa25-25ff-4b1d-904c-509d25496361 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:12.000882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ffa25-25ff-4b1d-904c-509d25496361 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:12.001600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ffa25-25ff-4b1d-904c-509d25496361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:12.021296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ffa25-25ff-4b1d-904c-509d25496361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:12.022963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ffa25-25ff-4b1d-904c-509d25496361 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:12.034953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 870/1715] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:12.713240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7bc96-1baa-4596-bad5-9377cab0572d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:12.714235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7bc96-1baa-4596-bad5-9377cab0572d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:12.714799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7bc96-1baa-4596-bad5-9377cab0572d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:12.717247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 846/1716] 10.222.0.30 () {54 vars in 912 bytes} [Mon Apr 4 06:10:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:12.723435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:12.723961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:12.723961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:12.761153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] MFA Rules not processed for user `6ada2f7acb1349e38b96dfbda5546101`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:12.765580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:12.936179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 871/1717] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:10:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:12.948037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7bc96-1baa-4596-bad5-9377cab0572d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:12.951859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-63c7bc96-1baa-4596-bad5-9377cab0572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:12.988072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:12.989950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:13.007142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a06525-1cf8-44ca-a12d-5ed852872f1f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:13.030124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:13.030809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:13.031202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:13.031614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:13.057740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:13.060506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7bc96-1baa-4596-bad5-9377cab0572d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:13.061670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:13.072617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:13.073930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:13.074529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:13.074993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] PATH_INFO: `/v3/users/279ee83b2ab844f88e98d8039a3f54d7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:13.088735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 872/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:13.089686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=279ee83b2ab844f88e98d8039a3f54d7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:13.098722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:13.118995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:13.120882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:13.138484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f612-45c4-4844-8075-237361e6d023 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:13.151810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88769d65-9075-4b72-8eed-b5ddac77eca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:13.153142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88769d65-9075-4b72-8eed-b5ddac77eca2 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:13.153698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88769d65-9075-4b72-8eed-b5ddac77eca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:13.154175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88769d65-9075-4b72-8eed-b5ddac77eca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:13.209122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279ee83b2ab844f88e98d8039a3f54d7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:13.223149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279ee83b2ab844f88e98d8039a3f54d7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:13.241855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279ee83b2ab844f88e98d8039a3f54d7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:13.247139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279ee83b2ab844f88e98d8039a3f54d7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:13.249073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2dffa19f-4e80-4099-b657-5a40014a1f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279ee83b2ab844f88e98d8039a3f54d7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:13.286736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 847/1719] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:12 2022] DELETE /identity/v3/users/279ee83b2ab844f88e98d8039a3f54d7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:13.290696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88769d65-9075-4b72-8eed-b5ddac77eca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:13.292735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88769d65-9075-4b72-8eed-b5ddac77eca2 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:13.303473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 873/1720] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:13.642273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:13.646644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:13.646963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:13.777493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] MFA Rules not processed for user `8b9373968e9c4eca8a038854815796ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:13.779495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:13.944425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 848/1721] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:14.104876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:14.105286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:14.105526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:14.131773 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:14.133315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.163356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] MFA Rules not processed for user `8d1c1bb5571f4b5cbde6b417c04ac484`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:14.165045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.279422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 874/1722] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:14.288852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:14.290518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.310067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e317-b261-46f7-a9df-56c0de98876c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:14.321690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:14.322593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:14.322859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:14.323133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] PATH_INFO: `/v3/projects/5ef627744431474292658424c03c177e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:14.325182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef627744431474292658424c03c177e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:14.330063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:14.418265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b22fa2-99e6-4440-b859-f1e39dfada34 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:14.435794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef627744431474292658424c03c177e', 'request_id': 'req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:14.448156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef627744431474292658424c03c177e', 'request_id': 'req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:14.461660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef627744431474292658424c03c177e', 'request_id': 'req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:14.491284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] The token cache is being invalidate because project 5ef627744431474292658424c03c177e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:14.491804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:14.497396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:14.504617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 849/1723] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:14 2022] DELETE /identity/v3/projects/5ef627744431474292658424c03c177e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:14.505858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:14.507585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.552779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:14.553486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:14.553762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:14.554045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:14.558311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.641431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:14.643167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3134da-dee3-4c00-ba3a-4bfc5c0459f8 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:14.643907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c52dfc-8db0-41b3-a1de-1b2ce3a47c5f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:14.651104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:14.653305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:14.653628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:14.655479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:14.657264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 875/1724] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:14.659388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:14.659637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:14.660775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:14.663254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.683489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] MFA Rules not processed for user `6b909365ef3640f3b15ec4ca0e7d6d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:14.685015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.755508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:14.758508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:14.768121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 876/1725] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:14.768957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:14.770914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:14.784877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 850/1726] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:14.976450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52be0-2f63-4ca4-9557-1f1e9c1ab196 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:14.992841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:14.996029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:14.998755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:15.000030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] PATH_INFO: `/v3/users/06b4b3a50efd43b4969e6545888f94d5` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:15.004982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b4b3a50efd43b4969e6545888f94d5)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:15.022039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:15.159290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b4b3a50efd43b4969e6545888f94d5'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:15.189115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b4b3a50efd43b4969e6545888f94d5'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:15.232937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b4b3a50efd43b4969e6545888f94d5'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:15.252690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b4b3a50efd43b4969e6545888f94d5'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:15.253394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3b4a6f7a-bbac-4c90-a1bd-7fe933a35eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b4b3a50efd43b4969e6545888f94d5'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:15.270333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 877/1727] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:14 2022] DELETE /identity/v3/users/06b4b3a50efd43b4969e6545888f94d5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:16.338350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:16.355447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c0aac-06b0-4d7f-a26d-1794d515b3f6 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:16.615060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:16.635346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:16.635694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:16.636928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] PATH_INFO: `/v3/projects/5888d0d9a92b42af93c3a67af5022c48` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:16.641125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5888d0d9a92b42af93c3a67af5022c48)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:16.643204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:16.689799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9fc9-fcc0-4163-8e81-e24a27900be8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:16.691932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9fc9-fcc0-4163-8e81-e24a27900be8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:16.692583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e9fc9-fcc0-4163-8e81-e24a27900be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:16.755846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-218e9fc9-fcc0-4163-8e81-e24a27900be8 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:16.757617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-218e9fc9-fcc0-4163-8e81-e24a27900be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:16.859470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5888d0d9a92b42af93c3a67af5022c48', 'request_id': 'req-a9432c79-a32c-436b-bf99-e96a3e5b2b01'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:16.875851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5888d0d9a92b42af93c3a67af5022c48', 'request_id': 'req-a9432c79-a32c-436b-bf99-e96a3e5b2b01'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:16.893149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5888d0d9a92b42af93c3a67af5022c48', 'request_id': 'req-a9432c79-a32c-436b-bf99-e96a3e5b2b01'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:16.926903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] The token cache is being invalidate because project 5888d0d9a92b42af93c3a67af5022c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:16.927735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:16.932042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a9432c79-a32c-436b-bf99-e96a3e5b2b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:16.941652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 851/1728] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:16 2022] DELETE /identity/v3/projects/5888d0d9a92b42af93c3a67af5022c48 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:16.947169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:16.947743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:16.948216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:16.961823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 878/1729] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:10:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:17.000884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:17.002432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:17.237509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 852/1730] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:17.247288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:17.247720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:17.248141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:17.283662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:17.285024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:17.306395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 879/1731] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:17.310645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:17.327044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b539e-29a4-40a8-a915-5d97794aa17d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:17.335792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:17.337239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:17.347969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:17.349131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:17.349588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:17.349970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:17.351099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:17.351602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:17.364816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:17.410385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 853/1732] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:17.415058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:17.442866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f21ab-1e85-4f53-87e9-74683333e683 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:17.468411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:17.469289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:17.470224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:17.474163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:17.476297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:17.481861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:17.584479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0f98f-0594-4173-b815-4e3e9b763844 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:17.594344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 854/1733] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:17 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:17.597422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:17.605905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:17.613710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:17.613949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:17.615078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:17.812365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af86703-c61d-4362-b1f8-c78db22477a0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:17.825937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:17.826571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:17.826951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:17.827357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:17.828860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:17.831171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:17.834825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:17.837867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:17.854285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 880/1734] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 04 06:10:17.855481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:17.858546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:17.916036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 855/1735] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:17 2022] POST /identity/v3/users => generated 290 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:17.920654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:17.972473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c922ab-af2e-40bb-ac6b-5fc7c7d39704 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:17.984589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:17.993658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:17.994309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:17.994599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:17.995434 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:18.027341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:18.074011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 856/1736] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:18.075817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:18.125996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ab67-093e-44bc-8779-f112e80e96de admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:18.192946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:18.193760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:18.193927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:18.194198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:18.194784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5302cd-ff99-4439-a53d-098ac2c0ec9c service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:18.194981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:18.196688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:18.253207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 857/1737] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:18.255255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:18.286635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e99c1-9b2c-4c9c-840d-39db8123cfa7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:18.312605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:18.313594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:18.313870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:18.314143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] PATH_INFO: `/v3/projects/863304e7de6344908a4687c6009c8a60/users/070bd49540504285a03eb314f4941f92/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:18.382458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863304e7de6344908a4687c6009c8a60, user_id=070bd49540504285a03eb314f4941f92, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:18.397530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:18.440312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 858/1738] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:18 2022] PUT /identity/v3/projects/863304e7de6344908a4687c6009c8a60/users/070bd49540504285a03eb314f4941f92/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:18.442244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:18.444764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:18.474664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:18.475355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:18.475641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:18.475917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:18.494597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:18.794453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca29d-9cc0-48a9-91d0-8f85e80b6a56 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:18.835414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:18.835980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:18.836418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:18.836680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:18.836991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] PATH_INFO: `/v3/users/38c1a5c9e61a4077b1db74858903589f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:18.847911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da63d0e-469e-46b2-b65c-27ef4474ea21 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:18.848739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c1a5c9e61a4077b1db74858903589f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:18.857993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:18.907923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 881/1739] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 1053 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:18.909465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:18.912760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:18.913150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:19.050959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] MFA Rules not processed for user `070bd49540504285a03eb314f4941f92`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:19.055437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:19.149119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c1a5c9e61a4077b1db74858903589f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:19.190818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c1a5c9e61a4077b1db74858903589f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:19.227177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c1a5c9e61a4077b1db74858903589f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:19.228995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c1a5c9e61a4077b1db74858903589f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:19.231767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b34c37e5-d97b-4dd6-8f91-76bac541e690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c1a5c9e61a4077b1db74858903589f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:19.257705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 882/1740] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:19.264713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:19.331424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33130b0e-402d-4854-ae70-742191836cb8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:19.333251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 859/1741] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:18 2022] DELETE /identity/v3/users/38c1a5c9e61a4077b1db74858903589f => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:19.338790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:19.339756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:19.339756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:19.442259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:19.447058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:19.573193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:19.574172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:19.574745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:19.575212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:19.576366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:19.579882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:19.655404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 883/1742] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:19 2022] POST /identity/v3/projects => generated 381 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:19.659194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:19.661655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:19.695655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 860/1743] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:19.769473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05c6f-6069-495d-9b97-1ea7744e2406 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:19.778376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:19.781278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:19.821798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:19.825734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:19.826051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:19.826388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:19.827172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:19.850633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:19.943786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 884/1744] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:19 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:19.953010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:19.989906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157f79a-903d-4f75-80ac-146e5787bd17 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:20.029937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:20.033456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.035002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.036692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.037706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:20.047826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:20.072818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05265d-be33-4331-8fe2-475e7f130c11 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:20.077577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 885/1745] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:20.089248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:20.130998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8a0d-f390-4c17-b5ad-6fcc95d63139 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:20.157524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f0df-192f-4f1b-9558-417deda63390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:20.157822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f0df-192f-4f1b-9558-417deda63390 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.158259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f0df-192f-4f1b-9558-417deda63390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.158628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f0df-192f-4f1b-9558-417deda63390 admin admin] PATH_INFO: `/v3/projects/92ba3ada9d534ecfae262511dc7b473c/users/90aa0c31ba2146078bebaa7885cd6afe/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.228581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f0df-192f-4f1b-9558-417deda63390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ba3ada9d534ecfae262511dc7b473c, user_id=90aa0c31ba2146078bebaa7885cd6afe, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:20.237252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f0df-192f-4f1b-9558-417deda63390 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:20.272796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:20.280126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.280828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.284439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.291426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 886/1746] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:20 2022] PUT /identity/v3/projects/92ba3ada9d534ecfae262511dc7b473c/users/90aa0c31ba2146078bebaa7885cd6afe/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:20.293217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.301086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.302015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.326959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:20.333898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:20.396820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 861/1747] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:20.396937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] MFA Rules not processed for user `6ada2f7acb1349e38b96dfbda5546101`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:20.397022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:20.397095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:20.414820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0c813-c935-4830-9eaa-c642756fc0d9 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:20.628682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 887/1748] 10.222.0.37 () {58 vars in 1015 bytes} [Mon Apr 4 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:20.675200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fa2fe-6d5c-44b6-a8f6-8054328c3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:20.675943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fa2fe-6d5c-44b6-a8f6-8054328c3b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.676173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fa2fe-6d5c-44b6-a8f6-8054328c3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.676456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fa2fe-6d5c-44b6-a8f6-8054328c3b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.677227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fa2fe-6d5c-44b6-a8f6-8054328c3b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:20.678888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fa2fe-6d5c-44b6-a8f6-8054328c3b02 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:20.718457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 862/1749] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:20.720038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:20.744675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19c1a2-dcfd-40b5-9064-762b983f0c70 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:20.766843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:20.767770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.768051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.768333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] PATH_INFO: `/v3/projects/92ba3ada9d534ecfae262511dc7b473c/users/90aa0c31ba2146078bebaa7885cd6afe/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.770773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ba3ada9d534ecfae262511dc7b473c, user_id=90aa0c31ba2146078bebaa7885cd6afe, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:20.773562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:20.805575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 888/1750] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:20 2022] PUT /identity/v3/projects/92ba3ada9d534ecfae262511dc7b473c/users/90aa0c31ba2146078bebaa7885cd6afe/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:20.808234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485f98-2219-4809-b979-141a2177b213 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:20.808529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485f98-2219-4809-b979-141a2177b213 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:20.808811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485f98-2219-4809-b979-141a2177b213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:20.902078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8e485f98-2219-4809-b979-141a2177b213 None None] MFA Rules not processed for user `90aa0c31ba2146078bebaa7885cd6afe`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:20.903354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8e485f98-2219-4809-b979-141a2177b213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:21.049191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 863/1751] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:21.105331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:21.107620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:21.235583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b84d2-f006-42c7-932a-adea4d90d633 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:21.250145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:21.251020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:21.251308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:21.251582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:21.271276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:21.272982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:21.299092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 889/1752] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:21.498556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485f98-2219-4809-b979-141a2177b213 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:21.526273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485f98-2219-4809-b979-141a2177b213 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:21.542492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:21.543408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:21.543842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:21.544256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:21.547636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:21.662633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:21.664267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306db2f0-5fb7-4656-9695-53a42eb16c78 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:21.682560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 864/1753] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:22.828359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:22.828359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:22.965320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02084e7-6008-4328-ad60-bf58edd815ba service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:22.975388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:22.976736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:22.977216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:22.977757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] PATH_INFO: `/v3/projects/08d7eeffcac04a56b6f1ccf7013b02ae` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:22.981727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d7eeffcac04a56b6f1ccf7013b02ae)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:23.007228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:23.145854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d7eeffcac04a56b6f1ccf7013b02ae', 'request_id': 'req-98aabf2f-259b-499a-aad1-c7179e8a657b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:23.166798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d7eeffcac04a56b6f1ccf7013b02ae', 'request_id': 'req-98aabf2f-259b-499a-aad1-c7179e8a657b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:23.193916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d7eeffcac04a56b6f1ccf7013b02ae', 'request_id': 'req-98aabf2f-259b-499a-aad1-c7179e8a657b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:23.287552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] The token cache is being invalidate because project 08d7eeffcac04a56b6f1ccf7013b02ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:23.288165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:23.291735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98aabf2f-259b-499a-aad1-c7179e8a657b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:23.299481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 890/1754] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:22 2022] DELETE /identity/v3/projects/08d7eeffcac04a56b6f1ccf7013b02ae => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:23.304704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c80c6f-f727-4a9e-a98c-15cb8f2c7e02 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:23.305236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c80c6f-f727-4a9e-a98c-15cb8f2c7e02 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:23.305316 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c80c6f-f727-4a9e-a98c-15cb8f2c7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:23.337383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-48c80c6f-f727-4a9e-a98c-15cb8f2c7e02 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:23.346381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-48c80c6f-f727-4a9e-a98c-15cb8f2c7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:23.348221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:23.348512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:23.348792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:23.388706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] MFA Rules not processed for user `8d1c1bb5571f4b5cbde6b417c04ac484`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:23.391845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:23.548531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 865/1755] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:23.557952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:23.558543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:23.558965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:23.573091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 891/1756] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:23.612222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:23.613793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:23.646902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 866/1757] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:23.651133 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:23.670039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027597-e8af-4dc2-bb7f-35fad4d1c904 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:23.681196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:23.681884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:23.682262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:23.682548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:23.683387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:23.683741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:23.692061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:23.729896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 892/1758] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:23.731078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:23.749112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da8787-a06c-4e17-94d1-300c1975f0df None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:23.765811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb608cb-86e8-4597-bb76-53fc5ea0eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:23.766917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb608cb-86e8-4597-bb76-53fc5ea0eea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:23.767388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb608cb-86e8-4597-bb76-53fc5ea0eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:23.767847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb608cb-86e8-4597-bb76-53fc5ea0eea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:23.768752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb608cb-86e8-4597-bb76-53fc5ea0eea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:23.771082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb608cb-86e8-4597-bb76-53fc5ea0eea6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:23.859127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 867/1759] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:23 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:23.863799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:23.875977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335dd3a-ec05-4bdf-a6e6-984be008ffa6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:24.049436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:24.050658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:24.052572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:24.053078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:24.053551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:24.063572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:24.065453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:24.066870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:24.072814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:24.096331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] MFA Rules not processed for user `8b9373968e9c4eca8a038854815796ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:24.100062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:24.117717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 893/1760] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:23 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:24.123236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:24.154307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa86a-660d-4ddb-bfd4-611aa9309edd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:24.164663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:24.165856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:24.168944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:24.169367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:24.170386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:24.175043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:24.257849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 894/1761] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:24.263800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:24.295219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a9f6-6bce-49e0-9682-3f3227af9d1e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:24.308505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 868/1762] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:24.334272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a719c-0b22-4331-81f4-05df4c66df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:24.334974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a719c-0b22-4331-81f4-05df4c66df5d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:24.336010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a719c-0b22-4331-81f4-05df4c66df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:24.336010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a719c-0b22-4331-81f4-05df4c66df5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:24.336979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a719c-0b22-4331-81f4-05df4c66df5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:24.338611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a719c-0b22-4331-81f4-05df4c66df5d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:24.364275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 895/1763] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:24.365758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:24.376956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167d5b-d4ff-4da9-9dc5-3729f50f5c93 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:24.381556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:24.382462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:24.382740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:24.383101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] PATH_INFO: `/v3/projects/7a1f28e2d95a45aa954946d91abf1252/users/f2db0d568a804217a38581f86043bf7e/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:24.408788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1f28e2d95a45aa954946d91abf1252, user_id=f2db0d568a804217a38581f86043bf7e, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:24.411748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:24.442549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 869/1764] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:24 2022] PUT /identity/v3/projects/7a1f28e2d95a45aa954946d91abf1252/users/f2db0d568a804217a38581f86043bf7e/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:24.444036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:24.444468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:24.444889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:24.484382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] MFA Rules not processed for user `f2db0d568a804217a38581f86043bf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:24.485800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:24.627563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 896/1765] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:24.951525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:24.953656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:25.077559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0efbfd-6fa4-4486-9d2c-f7213afc4038 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:25.084381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fda48-8cbb-478f-b01e-26894a5750d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:25.085254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fda48-8cbb-478f-b01e-26894a5750d6 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:25.087990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fda48-8cbb-478f-b01e-26894a5750d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:25.087990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fda48-8cbb-478f-b01e-26894a5750d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:25.098259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fda48-8cbb-478f-b01e-26894a5750d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:25.100401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fda48-8cbb-478f-b01e-26894a5750d6 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:25.112935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 870/1766] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:25.448854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:25.620096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc16e0-b32b-4caf-bae2-73910adac924 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:25.642227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:25.643279 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:25.643591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:25.643930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] PATH_INFO: `/v3/users/f2db0d568a804217a38581f86043bf7e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:25.651211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2db0d568a804217a38581f86043bf7e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:25.653492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:25.751232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2db0d568a804217a38581f86043bf7e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:25.762561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2db0d568a804217a38581f86043bf7e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:25.804159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2db0d568a804217a38581f86043bf7e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:25.826473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2db0d568a804217a38581f86043bf7e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:25.827216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2db0d568a804217a38581f86043bf7e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:25.835372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 897/1767] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:25 2022] DELETE /identity/v3/users/f2db0d568a804217a38581f86043bf7e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:25.840408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:25.840949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:25.841840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:25.889660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:25.891387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:26.012629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 871/1768] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:26.028847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:26.030680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:26.161022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca70aca-16d6-43af-a9cd-420ed6e724c1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:26.172343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6d97b-c0eb-4070-852a-0f2c826ab7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:26.173934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6d97b-c0eb-4070-852a-0f2c826ab7ae service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:26.174325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6d97b-c0eb-4070-852a-0f2c826ab7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:26.174713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6d97b-c0eb-4070-852a-0f2c826ab7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:26.194837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6d97b-c0eb-4070-852a-0f2c826ab7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:26.196417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6d97b-c0eb-4070-852a-0f2c826ab7ae service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:26.241445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 898/1769] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:26.721615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:26.723145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:26.738141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35225649-8b93-419c-9ebf-da69abf062ea None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:26.755271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:26.756958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:26.757251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:26.757525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] PATH_INFO: `/v3/projects/7a1f28e2d95a45aa954946d91abf1252` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:26.759268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1f28e2d95a45aa954946d91abf1252)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:26.761438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:26.845923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1f28e2d95a45aa954946d91abf1252', 'request_id': 'req-4201ffd4-590d-4727-876d-1de8c6960bf4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:26.856695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1f28e2d95a45aa954946d91abf1252', 'request_id': 'req-4201ffd4-590d-4727-876d-1de8c6960bf4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:26.865210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1f28e2d95a45aa954946d91abf1252', 'request_id': 'req-4201ffd4-590d-4727-876d-1de8c6960bf4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:26.879425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] The token cache is being invalidate because project 7a1f28e2d95a45aa954946d91abf1252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:26.879896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:26.880615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4201ffd4-590d-4727-876d-1de8c6960bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:26.882630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 872/1770] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:26 2022] DELETE /identity/v3/projects/7a1f28e2d95a45aa954946d91abf1252 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:26.888078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:26.888615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:26.888697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:26.933327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:26.935303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:27.010079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 899/1771] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:27.018157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.018513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.018858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.038437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:27.039754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:27.049689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 873/1772] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:27.053962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.065655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31e71c-ca10-40fb-9b35-542c0e332e16 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.108126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.109033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.109426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.109798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.110649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:27.111055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.112784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.128892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 900/1773] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:10:27.133107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.144215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6124dfb-cc48-401a-8532-80c97213d231 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.149993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.150914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.151449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.151854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.153076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.155491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.207019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 874/1774] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:27 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:27.211005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.221548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cdb88-73ec-4c6d-a5bd-d9e1b1bb7621 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.295812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.296660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.297035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.297378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.298156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.300359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.323984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 901/1775] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:27 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:27.328343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.338967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4fe7-1fdf-43ec-a809-e1993b241b0d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.345340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.346178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.346525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.346875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.347683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.349400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.361090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 875/1776] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:27.365441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.376584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17b11c-c48d-41bc-bf6d-dd708184eda6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.382040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed2dd2-3db7-4e8a-8ae6-3e30f4e571e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.382724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed2dd2-3db7-4e8a-8ae6-3e30f4e571e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.383006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed2dd2-3db7-4e8a-8ae6-3e30f4e571e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.383281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed2dd2-3db7-4e8a-8ae6-3e30f4e571e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.384032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed2dd2-3db7-4e8a-8ae6-3e30f4e571e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.385677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed2dd2-3db7-4e8a-8ae6-3e30f4e571e8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.397678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 902/1777] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:27.405331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.416016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b497-ed52-499f-96db-22d630a18dea admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.421180 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.422093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.422375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.422702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] PATH_INFO: `/v3/projects/11898a893d4c400f9fa61aeac630d7db/users/cec6c32b76af46718389ffb3493817d0/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.437817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11898a893d4c400f9fa61aeac630d7db, user_id=cec6c32b76af46718389ffb3493817d0, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.440481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.458105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 876/1778] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:27 2022] PUT /identity/v3/projects/11898a893d4c400f9fa61aeac630d7db/users/cec6c32b76af46718389ffb3493817d0/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:27.469833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.470385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.470761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.499380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] MFA Rules not processed for user `cec6c32b76af46718389ffb3493817d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:27.500809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:27.579961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 903/1779] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:27.584392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.653343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff55c0-7ebe-433f-9978-daae7d87aec9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.661534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.662246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.662543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.662840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.663562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.665594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.727410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 877/1780] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:27 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:27.731342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.743703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15d191-9a74-427b-bd98-70d96c4a5496 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.832027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.832695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.833247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.833340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.834125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.836471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.869378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 904/1781] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:27 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:27.872281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.895470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db7a7-50a0-45d3-9d4e-ab6ca4616269 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.905812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.907022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.909479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.910133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:27.911052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:27.922115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:27.943575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 878/1782] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:27.947941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:27.963368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516a28-826a-4259-82da-12bbdfec3ec7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:27.977902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079465-5f44-4579-b470-882c7813500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:27.981289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079465-5f44-4579-b470-882c7813500e admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:27.981577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079465-5f44-4579-b470-882c7813500e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:27.981848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079465-5f44-4579-b470-882c7813500e admin admin] PATH_INFO: `/v3/projects/e43dd354f0e64e619b6301079556f410/users/66226c4be9514afba8b76d81e7b3ebe9/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:28.018270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079465-5f44-4579-b470-882c7813500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43dd354f0e64e619b6301079556f410, user_id=66226c4be9514afba8b76d81e7b3ebe9, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:28.024217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079465-5f44-4579-b470-882c7813500e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:28.087634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 905/1783] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:27 2022] PUT /identity/v3/projects/e43dd354f0e64e619b6301079556f410/users/66226c4be9514afba8b76d81e7b3ebe9/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:28.092186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:28.108063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079465-5f44-4579-b470-882c7813500e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:28.108738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f5acc-bb24-4f98-800b-feb5657c17bd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:28.110277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-24079465-5f44-4579-b470-882c7813500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:28.196148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079465-5f44-4579-b470-882c7813500e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:28.200464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:28.201167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:28.201449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:28.201563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:28.201722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:28.202461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:28.203063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:28.203397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:28.204211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:28.204523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:28.206453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:28.220646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 879/1784] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:28.224728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:28.254393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b10b-b48a-4042-9f1b-c4009c0b45c9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:28.281874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc9cd-3209-4224-90c4-46699940ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:28.283125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc9cd-3209-4224-90c4-46699940ba4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:28.283581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc9cd-3209-4224-90c4-46699940ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:28.284027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc9cd-3209-4224-90c4-46699940ba4f admin admin] PATH_INFO: `/v3/projects/e43dd354f0e64e619b6301079556f410/users/66226c4be9514afba8b76d81e7b3ebe9/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:28.290372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc9cd-3209-4224-90c4-46699940ba4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43dd354f0e64e619b6301079556f410, user_id=66226c4be9514afba8b76d81e7b3ebe9, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:28.293381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc9cd-3209-4224-90c4-46699940ba4f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:28.317496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:28.319109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:28.324402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 880/1785] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:28 2022] PUT /identity/v3/projects/e43dd354f0e64e619b6301079556f410/users/66226c4be9514afba8b76d81e7b3ebe9/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:28.336357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 906/1786] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:28.342952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:28.343324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:28.343650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:28.390705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] MFA Rules not processed for user `66226c4be9514afba8b76d81e7b3ebe9`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:28.392250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:28.507501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 881/1787] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:28.517592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:28.519188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:28.530202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b59ecc-0d4d-449e-bb91-7e89ac3efe35 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:28.594320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f801-4f6f-410e-aad2-f6934156ad05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:28.595407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f801-4f6f-410e-aad2-f6934156ad05 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:28.595842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f801-4f6f-410e-aad2-f6934156ad05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:28.596356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f801-4f6f-410e-aad2-f6934156ad05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:28.607227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f801-4f6f-410e-aad2-f6934156ad05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:28.609164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f801-4f6f-410e-aad2-f6934156ad05 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:28.619835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 907/1788] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:29.337807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:29.421236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ffd2d-ec31-4dce-98dd-4b34e35ec241 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:29.425839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:29.426930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:29.427204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:29.427470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] PATH_INFO: `/v3/users/cec6c32b76af46718389ffb3493817d0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:29.428658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec6c32b76af46718389ffb3493817d0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:29.430606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:29.483945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec6c32b76af46718389ffb3493817d0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:29.490763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec6c32b76af46718389ffb3493817d0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:29.498903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec6c32b76af46718389ffb3493817d0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:29.499745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec6c32b76af46718389ffb3493817d0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:29.500493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec6c32b76af46718389ffb3493817d0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:29.518952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 882/1789] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:29 2022] DELETE /identity/v3/users/cec6c32b76af46718389ffb3493817d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:29.523467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:29.523995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:29.523995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:29.541177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:29.542364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:29.603610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 908/1790] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:29.614496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:29.616124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:29.671576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569ce2e-2898-4665-904d-34fdd7f6ba0e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:29.675490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:29.676157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:29.676416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:29.676690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:29.685771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:29.687252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:29.697116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 883/1791] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:29.985612 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:29.987337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:30.007123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067038f-c8a2-43ad-9ef2-955488781c63 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:30.013318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:30.014772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:30.015147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:30.015536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] PATH_INFO: `/v3/projects/11898a893d4c400f9fa61aeac630d7db` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:30.017113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] RBAC: Authorizing `identity:delete_project(project_id=11898a893d4c400f9fa61aeac630d7db)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:30.019079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:30.067267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11898a893d4c400f9fa61aeac630d7db', 'request_id': 'req-90ba3f57-fcce-44aa-9256-e248e352ebba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.074663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11898a893d4c400f9fa61aeac630d7db', 'request_id': 'req-90ba3f57-fcce-44aa-9256-e248e352ebba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.080109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11898a893d4c400f9fa61aeac630d7db', 'request_id': 'req-90ba3f57-fcce-44aa-9256-e248e352ebba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.090642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] The token cache is being invalidate because project 11898a893d4c400f9fa61aeac630d7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:30.090925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.091554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.093284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 909/1792] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:29 2022] DELETE /identity/v3/projects/11898a893d4c400f9fa61aeac630d7db => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:30.097462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:30.107201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f656f-45a1-43f1-af81-cbecef94aac0 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:30.165670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:30.166559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:30.166846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:30.167121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] PATH_INFO: `/v3/users/66226c4be9514afba8b76d81e7b3ebe9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:30.168442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66226c4be9514afba8b76d81e7b3ebe9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:30.170426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:30.214995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66226c4be9514afba8b76d81e7b3ebe9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.222386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66226c4be9514afba8b76d81e7b3ebe9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.230212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66226c4be9514afba8b76d81e7b3ebe9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.230868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66226c4be9514afba8b76d81e7b3ebe9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.231485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2102fe7d-8630-4872-9c1a-8ffa38868b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66226c4be9514afba8b76d81e7b3ebe9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.249871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 884/1793] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:30 2022] DELETE /identity/v3/users/66226c4be9514afba8b76d81e7b3ebe9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:30.602740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:30.604341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:30.617964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3f57-fcce-44aa-9256-e248e352ebba admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:30.675080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:30.676360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:30.676725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:30.677111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] PATH_INFO: `/v3/projects/e43dd354f0e64e619b6301079556f410` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:30.679042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43dd354f0e64e619b6301079556f410)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:30.681629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:30.741896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43dd354f0e64e619b6301079556f410', 'request_id': 'req-a66a923b-d917-4823-a955-f8588b82c755'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.751734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43dd354f0e64e619b6301079556f410', 'request_id': 'req-a66a923b-d917-4823-a955-f8588b82c755'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.757381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43dd354f0e64e619b6301079556f410', 'request_id': 'req-a66a923b-d917-4823-a955-f8588b82c755'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.771746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] The token cache is being invalidate because project e43dd354f0e64e619b6301079556f410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:30.772135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.772940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a66a923b-d917-4823-a955-f8588b82c755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:30.774594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 910/1794] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:30 2022] DELETE /identity/v3/projects/e43dd354f0e64e619b6301079556f410 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:30.782705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:30.783291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:30.783291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:30.804938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:30.807481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:30.873847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 885/1795] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:30.882298 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:30.882690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:30.883024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:30.903337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:30.904693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:30.912929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 911/1796] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:30.918088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:30.951077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fd7c1-1e6f-4418-a0f1-b2675e0ab490 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:30.963744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:30.964471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:30.964778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:30.965100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:30.965845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:30.966172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:30.967872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:30.985936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 886/1797] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:30.987092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.008375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60b7f-b77f-4eb4-9233-1ccff873dae0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.033471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.034174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.034458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.034732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.035441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.039582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.068658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 912/1798] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:30 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:31.072526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.083955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31acc-879f-474f-bb63-b9c778292f2f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.158161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.158921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.159268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.159592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.160371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.163622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.187797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 887/1799] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:31 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:31.192153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.203629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7e642-91a2-4966-a53a-fd44f9e51af7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.216245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.217251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.218245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.218675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.219670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.221910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.236943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 913/1800] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:31.239744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.249635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dfea3-98d8-4842-90b6-36208c67d401 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.254907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05b86-acd7-418d-a44c-cc3ca3ef334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.255561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05b86-acd7-418d-a44c-cc3ca3ef334b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.255836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05b86-acd7-418d-a44c-cc3ca3ef334b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.256103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05b86-acd7-418d-a44c-cc3ca3ef334b admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.256828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05b86-acd7-418d-a44c-cc3ca3ef334b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.258447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05b86-acd7-418d-a44c-cc3ca3ef334b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.268864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 888/1801] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:31.273048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.283389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d433be9-3a2a-47d8-b355-ed98da1acd33 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.287870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.288750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.289063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.289325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] PATH_INFO: `/v3/projects/596c831847f24a3c838a9fbb6e891162/users/5f1802d1b7424b448d526f9e4c9f5430/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.304666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596c831847f24a3c838a9fbb6e891162, user_id=5f1802d1b7424b448d526f9e4c9f5430, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.307705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.343708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 914/1802] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:31 2022] PUT /identity/v3/projects/596c831847f24a3c838a9fbb6e891162/users/5f1802d1b7424b448d526f9e4c9f5430/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:31.345794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.346080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.346353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.398867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] MFA Rules not processed for user `5f1802d1b7424b448d526f9e4c9f5430`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:31.400071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:31.496350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 889/1803] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:31.504606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.581880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570925d9-80f0-4b9d-b5d0-650988a05303 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.586506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.587179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.587464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.587740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.588554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.590544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.625175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 915/1804] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:31 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:31.629487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.641699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01207c7f-a6b8-4922-85ea-bfb793f5633e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.704042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.704731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.705047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.705344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.706045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.708007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.729558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 890/1805] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:31 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:31.733524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.745093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44c21-8694-418c-8b19-b73e088f62ea admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.751227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.752065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.752444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.752815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.753688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.755402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.767351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 916/1806] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:31.772200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.782633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362dd1-5e01-4cc6-9b0e-054664211454 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.790654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.794102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.794470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.794751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] PATH_INFO: `/v3/projects/2fcde1cc804c4ae88a940d23453f05c3/users/68780f4151434a4ab8f344fbaa974725/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.813234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcde1cc804c4ae88a940d23453f05c3, user_id=68780f4151434a4ab8f344fbaa974725, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.815895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.831886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 891/1807] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:31 2022] PUT /identity/v3/projects/2fcde1cc804c4ae88a940d23453f05c3/users/68780f4151434a4ab8f344fbaa974725/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:31.835969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.860187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dc8b3-31f1-4d1d-9cc9-1b235b180c46 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.931520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2910-f50b-431e-bab8-97688f85fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.932409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2910-f50b-431e-bab8-97688f85fed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.932801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2910-f50b-431e-bab8-97688f85fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.933282 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2910-f50b-431e-bab8-97688f85fed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.934241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2910-f50b-431e-bab8-97688f85fed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.935962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2910-f50b-431e-bab8-97688f85fed9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:31.950081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 917/1808] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:31.951554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:31.969039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cc878-5243-4ccc-a2df-2915e633abb9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:31.977813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:31.978731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:31.979012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:31.979307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] PATH_INFO: `/v3/projects/2fcde1cc804c4ae88a940d23453f05c3/users/68780f4151434a4ab8f344fbaa974725/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:31.981335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcde1cc804c4ae88a940d23453f05c3, user_id=68780f4151434a4ab8f344fbaa974725, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:31.984653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:32.001248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 892/1809] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:31 2022] PUT /identity/v3/projects/2fcde1cc804c4ae88a940d23453f05c3/users/68780f4151434a4ab8f344fbaa974725/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:32.008552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:32.009012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:32.009354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:32.036461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] MFA Rules not processed for user `68780f4151434a4ab8f344fbaa974725`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:32.038620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:32.112238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 918/1810] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:34.295909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:34.297927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:34.364694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:34.365320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33381e-39b1-421f-851c-b917682f81ed admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:34.368127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:34.368993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:34.370044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:34.370244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:34.371061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:34.372495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:34.384308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:34.385420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81390a34-84d5-4002-91e6-9c8a91b37044 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:34.386149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399320f-1426-4b44-b547-28372762c595 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:34.393120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054a3a9-6048-4970-b701-427f03c78cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:34.394383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054a3a9-6048-4970-b701-427f03c78cbd service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:34.394839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054a3a9-6048-4970-b701-427f03c78cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:34.395453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054a3a9-6048-4970-b701-427f03c78cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:34.397232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 893/1811] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:34.404686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054a3a9-6048-4970-b701-427f03c78cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:34.405832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054a3a9-6048-4970-b701-427f03c78cbd service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:34.415361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 919/1812] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:35.456184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928c90-ab65-4703-8890-8374ed92d6cb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:35.457067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928c90-ab65-4703-8890-8374ed92d6cb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:35.457565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928c90-ab65-4703-8890-8374ed92d6cb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:35.461447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 894/1813] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:10:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:35.490057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:35.491746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:35.492409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:35.523328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7a11-ce79-4d05-940b-902ef14b3cfb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:35.523658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7a11-ce79-4d05-940b-902ef14b3cfb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:35.524006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b7a11-ce79-4d05-940b-902ef14b3cfb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:35.526481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 895/1814] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:35.539265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:35.539546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:35.540179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:35.549707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:35.554178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:35.598829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:35.613457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:35.718451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 920/1815] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:10:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:35.741034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:35.742872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:35.771746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786ba9c-c800-4a93-a3df-a6d49f0b2679 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:35.785135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 896/1816] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:10:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 04 06:10:35.795618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:35.800083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:35.800502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:35.800779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:35.807410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:35.811085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:35.837383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:35.839061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:35.844858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1338a6-1385-4b8a-a1d2-1f32feb0b793 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:35.852323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 921/1817] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:35.855199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:35.855875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:35.856159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:35.856435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:35.874742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:35.876689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:35.905390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 897/1818] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:41.799583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:41.801967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:41.830026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:41.831885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:41.912529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddccdf-5d3a-4dbc-a64d-65f604a5f57b service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:41.920358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dcf7b-f33a-448d-bf09-af3764fb996e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:41.922281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dcf7b-f33a-448d-bf09-af3764fb996e service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:41.923270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dcf7b-f33a-448d-bf09-af3764fb996e service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:41.923697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dcf7b-f33a-448d-bf09-af3764fb996e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:41.931336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033e5b6-dca9-4c42-993e-35c65317ad8d service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:41.937465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:41.938366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:41.938644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:41.938915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] PATH_INFO: `/v3/users/506e8e05abc344798c5f7e5023aa1f4c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:41.939264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dcf7b-f33a-448d-bf09-af3764fb996e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:41.940187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] RBAC: Authorizing `identity:delete_user(user_id=506e8e05abc344798c5f7e5023aa1f4c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:41.941837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dcf7b-f33a-448d-bf09-af3764fb996e service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:41.942901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:41.957668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 922/1819] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:42.069463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506e8e05abc344798c5f7e5023aa1f4c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.079224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506e8e05abc344798c5f7e5023aa1f4c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.109362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506e8e05abc344798c5f7e5023aa1f4c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.110352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506e8e05abc344798c5f7e5023aa1f4c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.111131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506e8e05abc344798c5f7e5023aa1f4c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.148486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 898/1820] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:41 2022] DELETE /identity/v3/users/506e8e05abc344798c5f7e5023aa1f4c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:42.153433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:42.153871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:42.154302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:42.196672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:42.197871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:42.294962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 923/1821] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:42.306448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:42.307860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:42.388176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da630df-7963-43c3-95ba-264e4f2a287e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:42.400360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:42.401175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:42.401483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:42.401757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:42.420750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:42.422196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:42.457513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 899/1822] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:42.517728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:42.519306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:42.628737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8f5c-19d2-4ce3-a6b8-28558004b64b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:42.643822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68780f4151434a4ab8f344fbaa974725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fcde1cc804c4ae88a940d23453f05c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:42.644699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:42.645076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:42.645537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:42.646450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:42.647021 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:42.649243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:42.665084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 924/1823] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:42.668755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:42.682538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda17a-155c-4a78-81ea-ca2f59a04ed2 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:42.688138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68780f4151434a4ab8f344fbaa974725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fcde1cc804c4ae88a940d23453f05c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:42.689237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:42.689682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:42.690173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:42.691101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:42.693437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:42.727723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 900/1824] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:42 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:42.731399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:42.741927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58571a-1150-46ed-b3e9-0750d7af3418 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:42.812590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68780f4151434a4ab8f344fbaa974725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fcde1cc804c4ae88a940d23453f05c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:42.813384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:42.813735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:42.814079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:42.814879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:42.815197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:42.817248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:42.832986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 925/1825] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:42.868965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:42.879816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822981-1bdb-432d-9f0a-3585c301d52f tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:42.884511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68780f4151434a4ab8f344fbaa974725', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fcde1cc804c4ae88a940d23453f05c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:42.885457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:42.885740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:42.886015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] PATH_INFO: `/v3/projects/d619615732ae412fbca04679f90778c9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:42.887233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d619615732ae412fbca04679f90778c9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:42.889564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:42.941297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd619615732ae412fbca04679f90778c9', 'request_id': 'req-9e56e917-3da2-4e72-95f9-dbf26f75127d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.950127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd619615732ae412fbca04679f90778c9', 'request_id': 'req-9e56e917-3da2-4e72-95f9-dbf26f75127d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.957377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd619615732ae412fbca04679f90778c9', 'request_id': 'req-9e56e917-3da2-4e72-95f9-dbf26f75127d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.968304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] The token cache is being invalidate because project d619615732ae412fbca04679f90778c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:42.968592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.969271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:42.970874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 901/1826] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:42 2022] DELETE /identity/v3/projects/d619615732ae412fbca04679f90778c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:43.058890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:43.061423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:43.159682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e39810-06c4-4f7f-9d95-9b68f79b23d8 tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:43.228733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:43.233392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:43.233392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:43.233392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] PATH_INFO: `/v3/projects/fd29dc9da0894698a79d613713e2ec8b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:43.233392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd29dc9da0894698a79d613713e2ec8b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:43.234465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:43.234608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:43.235967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:43.253620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56e917-3da2-4e72-95f9-dbf26f75127d tempest-VolumeQuotaClassesTest-508407924 tempest-VolumeQuotaClassesTest-508407924-project-admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:43.258950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:43.260017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:43.260466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:43.260880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] PATH_INFO: `/v3/users/5f1802d1b7424b448d526f9e4c9f5430` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:43.262484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1802d1b7424b448d526f9e4c9f5430)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:43.264945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:43.291796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd29dc9da0894698a79d613713e2ec8b', 'request_id': 'req-f3f73a16-0ac4-49da-a6a4-a0ae98270467'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.300128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd29dc9da0894698a79d613713e2ec8b', 'request_id': 'req-f3f73a16-0ac4-49da-a6a4-a0ae98270467'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.307404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd29dc9da0894698a79d613713e2ec8b', 'request_id': 'req-f3f73a16-0ac4-49da-a6a4-a0ae98270467'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.318401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] The token cache is being invalidate because project fd29dc9da0894698a79d613713e2ec8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:43.318719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.319340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.320422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1802d1b7424b448d526f9e4c9f5430'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.321164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 926/1827] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:43 2022] DELETE /identity/v3/projects/fd29dc9da0894698a79d613713e2ec8b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:43.324880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:43.326553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:43.330372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1802d1b7424b448d526f9e4c9f5430'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.340712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1802d1b7424b448d526f9e4c9f5430'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.341432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1802d1b7424b448d526f9e4c9f5430'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.342103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5300f808-879d-414c-80b3-5328de6f9104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1802d1b7424b448d526f9e4c9f5430'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.359687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 902/1828] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:43 2022] DELETE /identity/v3/users/5f1802d1b7424b448d526f9e4c9f5430 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:43.364361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:43.364877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:43.365215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:43.382156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:43.383370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:43.397955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73a16-0ac4-49da-a6a4-a0ae98270467 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:43.441978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 903/1829] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:43.451435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:43.452323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:43.452595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:43.452835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:43.452995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] PATH_INFO: `/v3/users/b2f52c39d42446eebf1d08868f786593` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:43.454212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f52c39d42446eebf1d08868f786593)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:43.454481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:43.456131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:43.503655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f52c39d42446eebf1d08868f786593'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.510806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f52c39d42446eebf1d08868f786593'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.515791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b97ac-5abd-4a59-87ca-12552026dcf3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:43.520093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:43.520750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:43.521168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:43.521328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:43.523425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f52c39d42446eebf1d08868f786593'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.531591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:43.532075 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f52c39d42446eebf1d08868f786593'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.532754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f52c39d42446eebf1d08868f786593'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:43.533325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:43.538925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 927/1830] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:43 2022] DELETE /identity/v3/users/b2f52c39d42446eebf1d08868f786593 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:43.543146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 904/1831] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:44.112926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:44.115164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:44.118686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:44.120701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:44.137420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da50e-bdfe-4904-bc28-78a053c7efca service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:44.189861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf931a7-598f-4d4d-98d4-c18ca04a4c43 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:44.194714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:44.195687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:44.195977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:44.196856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] PATH_INFO: `/v3/projects/ae6a3d08b1fb400f8aa939fada9faba4` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:44.198095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6a3d08b1fb400f8aa939fada9faba4)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:44.200009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:44.202950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:44.203852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:44.204129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:44.204403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] PATH_INFO: `/v3/projects/596c831847f24a3c838a9fbb6e891162` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:44.205607 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596c831847f24a3c838a9fbb6e891162)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:44.207640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:44.245791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6a3d08b1fb400f8aa939fada9faba4', 'request_id': 'req-6f2bfd21-11b2-4865-8a29-568ee7993adf'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.254208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6a3d08b1fb400f8aa939fada9faba4', 'request_id': 'req-6f2bfd21-11b2-4865-8a29-568ee7993adf'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.254412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596c831847f24a3c838a9fbb6e891162', 'request_id': 'req-07b46ebf-d55d-4ebc-97c5-42094b826035'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.259769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6a3d08b1fb400f8aa939fada9faba4', 'request_id': 'req-6f2bfd21-11b2-4865-8a29-568ee7993adf'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.261635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596c831847f24a3c838a9fbb6e891162', 'request_id': 'req-07b46ebf-d55d-4ebc-97c5-42094b826035'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.268700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596c831847f24a3c838a9fbb6e891162', 'request_id': 'req-07b46ebf-d55d-4ebc-97c5-42094b826035'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.271641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] The token cache is being invalidate because project ae6a3d08b1fb400f8aa939fada9faba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:44.272013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.272740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.274596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 928/1832] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:44 2022] DELETE /identity/v3/projects/ae6a3d08b1fb400f8aa939fada9faba4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:44.278541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:44.279405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] The token cache is being invalidate because project 596c831847f24a3c838a9fbb6e891162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:44.279691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.279850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:44.280400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.284739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 905/1833] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:44 2022] DELETE /identity/v3/projects/596c831847f24a3c838a9fbb6e891162 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:44.285785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:44.287342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:44.352276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46ebf-d55d-4ebc-97c5-42094b826035 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:44.353455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bfd21-11b2-4865-8a29-568ee7993adf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:44.358530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:44.358671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:44.359626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:44.359734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:44.359945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] PATH_INFO: `/v3/users/d1cbefdb3b7c491c9ef94a6099417913` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:44.360365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:44.360784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:44.361129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] PATH_INFO: `/v3/users/68780f4151434a4ab8f344fbaa974725` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:44.361241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cbefdb3b7c491c9ef94a6099417913)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:44.362590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68780f4151434a4ab8f344fbaa974725)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:44.363217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:44.365982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:44.422029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cbefdb3b7c491c9ef94a6099417913'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.426960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68780f4151434a4ab8f344fbaa974725'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.434474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cbefdb3b7c491c9ef94a6099417913'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.434629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68780f4151434a4ab8f344fbaa974725'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.443109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68780f4151434a4ab8f344fbaa974725'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.443933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68780f4151434a4ab8f344fbaa974725'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.444674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68780f4151434a4ab8f344fbaa974725'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.448864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cbefdb3b7c491c9ef94a6099417913'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.460974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cbefdb3b7c491c9ef94a6099417913'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.462658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cbefdb3b7c491c9ef94a6099417913'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:44.466249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 906/1834] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:44 2022] DELETE /identity/v3/users/68780f4151434a4ab8f344fbaa974725 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:44.472690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 929/1835] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:44 2022] DELETE /identity/v3/users/d1cbefdb3b7c491c9ef94a6099417913 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:45.106438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.107951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.113875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.115453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.210535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5285-8fb7-4246-80f7-fcdf7de43423 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.210892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33b6ba-49e2-4d8a-9e3b-867ae28be32d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.215975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.216995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.217243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.217462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.217716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] PATH_INFO: `/v3/projects/2fcde1cc804c4ae88a940d23453f05c3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.218871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.219002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcde1cc804c4ae88a940d23453f05c3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.219194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.219432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] PATH_INFO: `/v3/projects/9da25b2be3c24d6c85c04115c1e3070d` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.220654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da25b2be3c24d6c85c04115c1e3070d)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.220919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.222928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.268952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcde1cc804c4ae88a940d23453f05c3', 'request_id': 'req-57a82767-1625-408a-9249-0f3f55f3c885'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.276680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcde1cc804c4ae88a940d23453f05c3', 'request_id': 'req-57a82767-1625-408a-9249-0f3f55f3c885'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.278977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da25b2be3c24d6c85c04115c1e3070d', 'request_id': 'req-359d90b5-81d6-442c-b187-23ce3af5e267'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.283039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcde1cc804c4ae88a940d23453f05c3', 'request_id': 'req-57a82767-1625-408a-9249-0f3f55f3c885'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.286484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da25b2be3c24d6c85c04115c1e3070d', 'request_id': 'req-359d90b5-81d6-442c-b187-23ce3af5e267'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.291921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da25b2be3c24d6c85c04115c1e3070d', 'request_id': 'req-359d90b5-81d6-442c-b187-23ce3af5e267'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.294063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] The token cache is being invalidate because project 2fcde1cc804c4ae88a940d23453f05c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:45.294355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.294983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57a82767-1625-408a-9249-0f3f55f3c885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.296566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 907/1836] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:45 2022] DELETE /identity/v3/projects/2fcde1cc804c4ae88a940d23453f05c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:45.301329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7fd3-cb11-47ad-bc84-01d6d727edbd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.301614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7fd3-cb11-47ad-bc84-01d6d727edbd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.302007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7fd3-cb11-47ad-bc84-01d6d727edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.303374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] The token cache is being invalidate because project 9da25b2be3c24d6c85c04115c1e3070d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:45.303666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.304301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-359d90b5-81d6-442c-b187-23ce3af5e267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:45.305953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 930/1837] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:45 2022] DELETE /identity/v3/projects/9da25b2be3c24d6c85c04115c1e3070d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:45.311738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf9d0-2195-4988-8b69-726df6dcad11 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.312027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf9d0-2195-4988-8b69-726df6dcad11 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.312306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf9d0-2195-4988-8b69-726df6dcad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.320169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cbcf7fd3-cb11-47ad-bc84-01d6d727edbd None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:45.321392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cbcf7fd3-cb11-47ad-bc84-01d6d727edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.330145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-301bf9d0-2195-4988-8b69-726df6dcad11 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:45.331321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-301bf9d0-2195-4988-8b69-726df6dcad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.377449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 908/1838] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:45.386315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.386600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.386880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.392731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 931/1839] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:45.401058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.401351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.401623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.405800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:45.407011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.415254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 909/1840] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:45.419422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.420856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:45.422073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.428492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba023ad-e735-48b8-bbe7-60fcfe79545a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.433669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 932/1841] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:45.434640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.436397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.437092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.437379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.437649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.438360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:45.438693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.440523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.444178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cecebc-ada7-48d0-b50a-4c7c22167038 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.449978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.450628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.450904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.451169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.451885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:45.452213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.452629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 910/1842] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:10:45.457003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.457586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.466782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067903d-5839-45a1-9287-51d2a62885af admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.469887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 933/1843] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:10:45.473477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.473477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.473659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.473932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.474357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.474619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.476515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.484502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901bc10-ee5c-4e60-9263-8c4c8e488101 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.489837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.490492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.490769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.491044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.491730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.493644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.506060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 911/1844] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:45.510946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.524284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 934/1845] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:45.528426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.578972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1cf4-92f4-4204-970b-fb7c5746bee2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.636414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b1ced-4df2-4d5f-a946-2d3e67369733 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.650235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.651305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.651776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.652235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.653187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.655487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.673996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.674664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.674966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.675239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.676106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.678604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.683538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 935/1846] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:45.687275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.711100 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d331-e6f1-46b8-aa39-db6a4f066892 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.716382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 912/1847] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:45.717544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.721461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.722535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.723422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.724172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.725681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.728210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.730128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb677338-49a3-4ef5-aaf2-3a302b53f0a7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.736539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.737296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.737583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.740187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.741005 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.743093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.745099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 936/1848] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:45.748662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.760308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8933-2884-40d1-8bff-067f70e4b0ab admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.765122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 913/1849] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:45.766310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.770687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.772028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.772525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.773023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.773971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.775799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.778126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea787a4c-6b9b-4e01-9bb2-760710aaf48b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.783831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.784444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.784732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.785314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.786133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.787802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.792832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 937/1850] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:45.797764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.810237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 914/1851] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:45.811432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:45.814853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2516ce-2333-4579-925c-9caa8408ad65 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.821770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae1c2-15a0-4377-a272-f1342ed7196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.823725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236fc8c-b5b2-4fd1-b865-94b2d1f772c1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:45.824353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae1c2-15a0-4377-a272-f1342ed7196e admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.824956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae1c2-15a0-4377-a272-f1342ed7196e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.825540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae1c2-15a0-4377-a272-f1342ed7196e admin admin] PATH_INFO: `/v3/projects/a9cda548b9d04c67b5036c98a05574d7/users/513edb4fd6fb484894ad7dfeae4d43aa/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.829139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf77132-08dd-4454-91b3-64a045b95d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:45.830562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf77132-08dd-4454-91b3-64a045b95d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.830562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf77132-08dd-4454-91b3-64a045b95d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.830562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf77132-08dd-4454-91b3-64a045b95d0e admin admin] PATH_INFO: `/v3/projects/faf7b5f717614794974609fd9dff73b5/users/57f4a9df43a4463399059f39e4b85cc4/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.844650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cae1c2-15a0-4377-a272-f1342ed7196e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cda548b9d04c67b5036c98a05574d7, user_id=513edb4fd6fb484894ad7dfeae4d43aa, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.847248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf77132-08dd-4454-91b3-64a045b95d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf7b5f717614794974609fd9dff73b5, user_id=57f4a9df43a4463399059f39e4b85cc4, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:45.849249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cae1c2-15a0-4377-a272-f1342ed7196e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.850008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf77132-08dd-4454-91b3-64a045b95d0e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:45.869441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 915/1852] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:45 2022] PUT /identity/v3/projects/faf7b5f717614794974609fd9dff73b5/users/57f4a9df43a4463399059f39e4b85cc4/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:45.871229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 938/1853] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:45 2022] PUT /identity/v3/projects/a9cda548b9d04c67b5036c98a05574d7/users/513edb4fd6fb484894ad7dfeae4d43aa/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:45.884586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.884586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.884586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.887191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:45.887479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:45.887869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:45.927024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] MFA Rules not processed for user `57f4a9df43a4463399059f39e4b85cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:45.928284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:45.945664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] MFA Rules not processed for user `513edb4fd6fb484894ad7dfeae4d43aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:45.949111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:46.008863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 916/1854] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:46.014588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.097269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 939/1855] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:46.100008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.132291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664f1db-144f-40d4-a648-cae34fb516a8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.143457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.144465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.144987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.145483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.146405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.148858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.188990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 917/1856] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:46 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:46.191423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.213294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3c06-0207-4781-a092-c93e77bfc286 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.334476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.335720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.338621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.338621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.339260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.342834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf60193-2848-49c5-bae8-9f1ceb1eac1b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.345725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.357301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.357963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.358387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.359110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.360048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.365046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.403049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 918/1857] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:46 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:46.407728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.414789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 940/1858] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:46 2022] POST /identity/v3/projects => generated 399 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:46.418543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.425190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001ebb-d94f-474e-8b65-2502fb48d375 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.525304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.526063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.526348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.526908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.527722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.528106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37425-61a4-4bc8-aaf1-75e39d607239 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.529689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.534533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.535605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.536815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.537275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.540002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.542020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.549374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 919/1859] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:46.551139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.570813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee852f-a420-4124-9fd5-aab6a665df09 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.577042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 941/1860] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:46 2022] POST /identity/v3/users => generated 306 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:46.578267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.579508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.579804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.580402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] PATH_INFO: `/v3/projects/8516048972194d80b4cb18cd3230b908/users/018e36655b584018b100d1c3b543a5c8/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.581782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.604351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab612f6-2cf1-42ba-a464-e3c5e0272478 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.607925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8516048972194d80b4cb18cd3230b908, user_id=018e36655b584018b100d1c3b543a5c8, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.612783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.613808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.615191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.615480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.615759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.617241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.621636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.637159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 920/1861] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:46 2022] PUT /identity/v3/projects/8516048972194d80b4cb18cd3230b908/users/018e36655b584018b100d1c3b543a5c8/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:46.638691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.643323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 942/1862] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:46.644519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.658317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c8438-96b1-46a2-83fa-bf4e42a1646a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.737373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.738809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.739359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.739976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] PATH_INFO: `/v3/projects/8b5029964de94e96b8755556e16bd737/users/defaa61ef90c4689b42e3fdb9b7a5166/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.775211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5029964de94e96b8755556e16bd737, user_id=defaa61ef90c4689b42e3fdb9b7a5166, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.778812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.799130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ed8e4-4021-42b2-b81f-033f8d8cd4b3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.813525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 943/1863] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:46 2022] PUT /identity/v3/projects/8b5029964de94e96b8755556e16bd737/users/defaa61ef90c4689b42e3fdb9b7a5166/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:46.817726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.911599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.912398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.912749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.913169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.914340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.916496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.930863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1687-518f-4f81-b271-6cf7ba371691 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.934650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 921/1864] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:46.935646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.937593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.938451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.938802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.939217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.940281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.942463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.947487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588b98e-2b5c-4691-9999-184d743a8c0d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.954334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a5ba-185f-4b3d-aeb3-6f8e76f4a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:46.955508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a5ba-185f-4b3d-aeb3-6f8e76f4a6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.959137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a5ba-185f-4b3d-aeb3-6f8e76f4a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.959137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a5ba-185f-4b3d-aeb3-6f8e76f4a6c5 admin admin] PATH_INFO: `/v3/projects/8516048972194d80b4cb18cd3230b908/users/018e36655b584018b100d1c3b543a5c8/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:46.959458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 944/1865] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:46.959549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a5ba-185f-4b3d-aeb3-6f8e76f4a6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8516048972194d80b4cb18cd3230b908, user_id=018e36655b584018b100d1c3b543a5c8, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:46.961147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:46.962988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a5ba-185f-4b3d-aeb3-6f8e76f4a6c5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:46.978500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e827e-d22c-4330-afa4-84feed6886d8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:46.980873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 922/1866] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:46 2022] PUT /identity/v3/projects/8516048972194d80b4cb18cd3230b908/users/018e36655b584018b100d1c3b543a5c8/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:46.992839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:46.993374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:46.993927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.083868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] MFA Rules not processed for user `018e36655b584018b100d1c3b543a5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:47.086121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.118893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55ad1-fbb9-42c9-a411-09bbb1d11ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.121804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55ad1-fbb9-42c9-a411-09bbb1d11ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.122294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55ad1-fbb9-42c9-a411-09bbb1d11ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.122646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55ad1-fbb9-42c9-a411-09bbb1d11ecb admin admin] PATH_INFO: `/v3/projects/8b5029964de94e96b8755556e16bd737/users/defaa61ef90c4689b42e3fdb9b7a5166/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.135666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55ad1-fbb9-42c9-a411-09bbb1d11ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5029964de94e96b8755556e16bd737, user_id=defaa61ef90c4689b42e3fdb9b7a5166, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:47.146984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55ad1-fbb9-42c9-a411-09bbb1d11ecb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:47.173752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 945/1867] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:46 2022] PUT /identity/v3/projects/8b5029964de94e96b8755556e16bd737/users/defaa61ef90c4689b42e3fdb9b7a5166/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:47.186334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.186733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.187588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.235664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] MFA Rules not processed for user `defaa61ef90c4689b42e3fdb9b7a5166`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:47.237284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.354902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 923/1868] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:47.372680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:47.374191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.415824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 946/1869] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:47.430980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:47.433758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.467385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b7ef-c101-4fa5-889b-3ff18fdaf366 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:47.517358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167aa25-2049-4733-bc71-318a6df2f566 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:47.524701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.525897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.526315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.526486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.527375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.527526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] PATH_INFO: `/v3/users/070bd49540504285a03eb314f4941f92` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.527835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.528266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.529346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=070bd49540504285a03eb314f4941f92)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:47.531474 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:47.605331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070bd49540504285a03eb314f4941f92'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:47.616438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:47.618501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:47.620033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070bd49540504285a03eb314f4941f92'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:47.635771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070bd49540504285a03eb314f4941f92'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:47.641736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 924/1870] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:47.642924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:47.646751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.649419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070bd49540504285a03eb314f4941f92'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:47.650224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8ee9adf8-63d0-4368-90f8-00f11f0cc1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070bd49540504285a03eb314f4941f92'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:47.666160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 947/1871] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:47 2022] DELETE /identity/v3/users/070bd49540504285a03eb314f4941f92 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:47.670634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.670925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.671202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.680119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ea20f-146c-401d-bf79-1a279b55433b service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:47.699517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:47.700885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.747222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.748094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.748523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.748798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.751070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.784314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 948/1872] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:47.785587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:47.787168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.799325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caecd0-9e64-447a-93b9-eac159b89510 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:47.810217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.810393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.810702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.810916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.812878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.836498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:47.838208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:47.852357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 925/1873] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:47.853570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:47.865264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.900966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:47.902436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:47.920625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 949/1874] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:47.939880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:47.941433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.952149 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746473e9-5215-4a73-9a2a-ab40224fdf48 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:47.954827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0281ab-0669-48ee-9d6f-4b0a076af5bc service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:47.955938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.956586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.957087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.957378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:47.959247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:47.959687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:47.960524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:47.960870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:47.961227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:48.006415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:48.010395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:48.040105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 926/1875] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:48.098243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:48.102466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:48.126476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 950/1876] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:10:48.513374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:48.515347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:48.545828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949fbc-6644-426e-bd3e-0c77c763c5a0 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:48.553180 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:48.554499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:48.554985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:48.556273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] PATH_INFO: `/v3/projects/863304e7de6344908a4687c6009c8a60` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:48.557845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863304e7de6344908a4687c6009c8a60)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:48.571117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:48.649599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863304e7de6344908a4687c6009c8a60', 'request_id': 'req-e4432baf-25e7-420d-b781-f7da67509ad5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.663365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863304e7de6344908a4687c6009c8a60', 'request_id': 'req-e4432baf-25e7-420d-b781-f7da67509ad5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.681422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863304e7de6344908a4687c6009c8a60', 'request_id': 'req-e4432baf-25e7-420d-b781-f7da67509ad5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.702250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] The token cache is being invalidate because project 863304e7de6344908a4687c6009c8a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:48.702608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.703896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.711621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:48.713211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 927/1877] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:48 2022] DELETE /identity/v3/projects/863304e7de6344908a4687c6009c8a60 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:48.725371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0747f-5a2b-4ad8-8d38-1990b2cb4f5c service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:48.800176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:48.801567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:48.801877 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:48.802150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] PATH_INFO: `/v3/users/90aa0c31ba2146078bebaa7885cd6afe` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:48.805471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90aa0c31ba2146078bebaa7885cd6afe)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:48.807763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:48.869957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90aa0c31ba2146078bebaa7885cd6afe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.877574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90aa0c31ba2146078bebaa7885cd6afe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.890540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90aa0c31ba2146078bebaa7885cd6afe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.900066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90aa0c31ba2146078bebaa7885cd6afe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.900750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2e01535b-bab3-407a-96f2-f52d2963d073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90aa0c31ba2146078bebaa7885cd6afe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:48.911281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 951/1878] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:48 2022] DELETE /identity/v3/users/90aa0c31ba2146078bebaa7885cd6afe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:49.199623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.201504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:49.216883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432baf-25e7-420d-b781-f7da67509ad5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.298844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.299729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.299982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.300280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] PATH_INFO: `/v3/projects/92ba3ada9d534ecfae262511dc7b473c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.301583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ba3ada9d534ecfae262511dc7b473c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.303583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.352272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ba3ada9d534ecfae262511dc7b473c', 'request_id': 'req-878c28d6-add1-4a6e-851e-e428503e7cbe'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:49.361719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ba3ada9d534ecfae262511dc7b473c', 'request_id': 'req-878c28d6-add1-4a6e-851e-e428503e7cbe'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:49.368218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ba3ada9d534ecfae262511dc7b473c', 'request_id': 'req-878c28d6-add1-4a6e-851e-e428503e7cbe'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:49.378195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] The token cache is being invalidate because project 92ba3ada9d534ecfae262511dc7b473c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:49.378409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:49.379077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-878c28d6-add1-4a6e-851e-e428503e7cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:49.384038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 928/1879] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:49 2022] DELETE /identity/v3/projects/92ba3ada9d534ecfae262511dc7b473c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:49.386639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.386754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.387010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.407309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:49.408759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:49.474719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 952/1880] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:49.482779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.483152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.483424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.504438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:49.505680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:49.519166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.521017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 929/1881] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:49.529249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007098-9a68-4331-a7ce-4d0055b3f1e3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.534295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.535054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.535329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.535608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.536339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:49.536645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.538276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.550060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 953/1882] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:49.554524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.564249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756a33-7298-4a1f-8489-539fdb729405 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.569466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.570126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.570405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.570700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.571402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.573317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.608181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 930/1883] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:49.611241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.621583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cdbeb-a050-471e-b9f6-73a288fb3ce5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.684650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.685357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.685638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.685910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.686687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.690458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.712471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 954/1884] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:49 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:49.718084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.732119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dcbb4-99a8-447e-bd12-deaf0b0d1b2e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.737275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.738189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.738986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.738986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.739555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.741510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.755654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 931/1885] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:49.760264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.771344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df7637-e5db-41f6-9c16-d5feb7cb4691 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.776373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da8319-9c7b-4b32-8ec1-f5ce9455783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.777113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da8319-9c7b-4b32-8ec1-f5ce9455783b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.777404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da8319-9c7b-4b32-8ec1-f5ce9455783b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.777680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da8319-9c7b-4b32-8ec1-f5ce9455783b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.778416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da8319-9c7b-4b32-8ec1-f5ce9455783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.780034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da8319-9c7b-4b32-8ec1-f5ce9455783b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.793648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 955/1886] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:49.796233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:49.815714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af19b95-143c-4c90-b55c-347c5015b92a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:49.820620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:49.821565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.821840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.822107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] PATH_INFO: `/v3/projects/9f86bb6720e74d5db38f3e8776af555d/users/b4739e86e9954477ac28e15f797dae3f/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.838717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f86bb6720e74d5db38f3e8776af555d, user_id=b4739e86e9954477ac28e15f797dae3f, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:49.841788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:49.858605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 932/1887] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:49 2022] PUT /identity/v3/projects/9f86bb6720e74d5db38f3e8776af555d/users/b4739e86e9954477ac28e15f797dae3f/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:49.869765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:49.870055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:49.870330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:49.901779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] MFA Rules not processed for user `b4739e86e9954477ac28e15f797dae3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:49.903340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:49.986699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 956/1888] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:49.997648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.061053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e540c45-06c9-42fa-96f8-400c4dc9a3cf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.066781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.067503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.067766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.068044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.068755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.070939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.096452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 933/1889] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:50.101033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.111905 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14075e03-8c2f-4823-be2f-60bc61ee62d0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.173008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.173724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.173964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.174222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.174914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.177027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.199267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 957/1890] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:50 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:50.203258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.214171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966afa-2d8f-4046-9255-0a5c17493ec9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.218767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.219463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.219739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.220010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.220735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.222372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.232522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 934/1891] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:50.236713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.247033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39e9b9-d064-4633-b9ca-c7e4d60f630e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.251662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.252544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.252820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.253155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] PATH_INFO: `/v3/projects/3a3a5e1eac3c435e8a0cc453901d32be/users/3203dc3a3de3441bb873f3917a8d8307/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.270059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3a5e1eac3c435e8a0cc453901d32be, user_id=3203dc3a3de3441bb873f3917a8d8307, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.272734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.289655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 958/1892] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:50 2022] PUT /identity/v3/projects/3a3a5e1eac3c435e8a0cc453901d32be/users/3203dc3a3de3441bb873f3917a8d8307/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:50.294160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.305675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ed49-71da-4c20-ab32-eb7c094b3e80 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.362834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c167-d2ac-401b-b40d-27270d4d40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.363586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c167-d2ac-401b-b40d-27270d4d40d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.363941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c167-d2ac-401b-b40d-27270d4d40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.364212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c167-d2ac-401b-b40d-27270d4d40d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.364940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c167-d2ac-401b-b40d-27270d4d40d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.366566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c167-d2ac-401b-b40d-27270d4d40d8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.376946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 935/1893] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:50.381562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.398131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed11662-2e95-4d8d-b0c9-bc048d12829b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.403387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.404285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.404560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.404827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] PATH_INFO: `/v3/projects/3a3a5e1eac3c435e8a0cc453901d32be/users/3203dc3a3de3441bb873f3917a8d8307/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.406817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3a5e1eac3c435e8a0cc453901d32be, user_id=3203dc3a3de3441bb873f3917a8d8307, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.409450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.420204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 959/1894] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:50 2022] PUT /identity/v3/projects/3a3a5e1eac3c435e8a0cc453901d32be/users/3203dc3a3de3441bb873f3917a8d8307/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:50.431376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.431656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.431931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.458585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] MFA Rules not processed for user `3203dc3a3de3441bb873f3917a8d8307`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:50.459837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:50.528640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 936/1895] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:50.540276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.542363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:50.604391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7544-670b-43d3-82a9-c5c5c4072283 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.609447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78289398-d335-4819-8ee1-b9f70ebad70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.610098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78289398-d335-4819-8ee1-b9f70ebad70f service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.610385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78289398-d335-4819-8ee1-b9f70ebad70f service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.610660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78289398-d335-4819-8ee1-b9f70ebad70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.624165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78289398-d335-4819-8ee1-b9f70ebad70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.625769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78289398-d335-4819-8ee1-b9f70ebad70f service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.638396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 960/1896] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:50.679057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.749381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b91d-a39b-4dac-ba8c-0eb7a7e02526 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:50.754493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:50.755366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.755640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.755906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] PATH_INFO: `/v3/users/b4739e86e9954477ac28e15f797dae3f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.757558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4739e86e9954477ac28e15f797dae3f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:50.759486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:50.807828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4739e86e9954477ac28e15f797dae3f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:50.814831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4739e86e9954477ac28e15f797dae3f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:50.824963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4739e86e9954477ac28e15f797dae3f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:50.825894 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4739e86e9954477ac28e15f797dae3f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:50.826510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4739e86e9954477ac28e15f797dae3f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:50.845786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 937/1897] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:50 2022] DELETE /identity/v3/users/b4739e86e9954477ac28e15f797dae3f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:50.850335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:50.850735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:50.851026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:50.870036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:50.871245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:50.933832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 961/1898] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:50.944334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:50.945808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:51.009112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25be9-a63a-4cc9-8b7a-3f9c90280ab3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:51.013284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:51.014457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:51.014762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:51.019166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:51.027211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:51.028629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:51.038351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 938/1899] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:51.396062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:51.397888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:51.426989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1542-4cc3-4e4d-9cef-1f18b9dcacc7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:51.438774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:51.439781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:51.440120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:51.440458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] PATH_INFO: `/v3/projects/9f86bb6720e74d5db38f3e8776af555d` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:51.442083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f86bb6720e74d5db38f3e8776af555d)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:51.444130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:51.500238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f86bb6720e74d5db38f3e8776af555d', 'request_id': 'req-674effde-29db-41b3-9dc8-4be26b2e802b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.513139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f86bb6720e74d5db38f3e8776af555d', 'request_id': 'req-674effde-29db-41b3-9dc8-4be26b2e802b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.526622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f86bb6720e74d5db38f3e8776af555d', 'request_id': 'req-674effde-29db-41b3-9dc8-4be26b2e802b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.541088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] The token cache is being invalidate because project 9f86bb6720e74d5db38f3e8776af555d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:51.541372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.542219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.543809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 962/1900] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:51 2022] DELETE /identity/v3/projects/9f86bb6720e74d5db38f3e8776af555d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:51.547995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:51.558368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b7b8a-bf94-4f9e-aff3-451591e6efbc service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:51.621814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:51.623304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:51.623719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:51.624124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] PATH_INFO: `/v3/users/3203dc3a3de3441bb873f3917a8d8307` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:51.625634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3203dc3a3de3441bb873f3917a8d8307)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:51.628001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:51.681311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3203dc3a3de3441bb873f3917a8d8307'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.688413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3203dc3a3de3441bb873f3917a8d8307'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.700675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3203dc3a3de3441bb873f3917a8d8307'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.701630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3203dc3a3de3441bb873f3917a8d8307'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.702221 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9ab76aeb-1679-489b-9b36-6ac009fa2a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3203dc3a3de3441bb873f3917a8d8307'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:51.719626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 939/1901] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:51 2022] DELETE /identity/v3/users/3203dc3a3de3441bb873f3917a8d8307 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:52.009847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.011335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:52.042747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674effde-29db-41b3-9dc8-4be26b2e802b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.101175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.102051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.102330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.102608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] PATH_INFO: `/v3/projects/3a3a5e1eac3c435e8a0cc453901d32be` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.103808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3a5e1eac3c435e8a0cc453901d32be)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.105756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.152137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3a5e1eac3c435e8a0cc453901d32be', 'request_id': 'req-98dda538-130c-4626-9557-90c8cf24fbba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:52.163350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3a5e1eac3c435e8a0cc453901d32be', 'request_id': 'req-98dda538-130c-4626-9557-90c8cf24fbba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:52.168875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3a5e1eac3c435e8a0cc453901d32be', 'request_id': 'req-98dda538-130c-4626-9557-90c8cf24fbba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:52.180775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] The token cache is being invalidate because project 3a3a5e1eac3c435e8a0cc453901d32be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:52.181094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:52.181871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98dda538-130c-4626-9557-90c8cf24fbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:52.183598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 963/1902] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:52 2022] DELETE /identity/v3/projects/3a3a5e1eac3c435e8a0cc453901d32be => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:52.188732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.189051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.189323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.208011 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:52.209235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:52.269067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 940/1903] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:52.277052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.277343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.277619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.298973 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:52.300188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:52.308934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 964/1904] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:52.313482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.324105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8138e3-be38-44eb-b847-3f255e6c32ae None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.333162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.333162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.333162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.333162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.333506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:52.333506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.334948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.347763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 941/1905] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:10:52.352151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.361186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad98173-59cc-4db8-9a35-c415853627a3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.366070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.366731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.367010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.367281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.367974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.369894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.402933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 965/1906] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:52.407082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.417774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2373d23-55fe-486d-9b6f-79b264444a9a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.477663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.478636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.479008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.479353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.480406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.483204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.507107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 942/1907] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:52.511184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.522055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02e1f-d878-495c-8c63-39e01b29f972 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.526935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.527590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.527861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.528137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.528862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.530461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.540580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 966/1908] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:52.544586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.555175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59fd3c-36ee-47f4-848b-3686a0287d28 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.560818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a8db-a0c4-4562-82d9-397d5167853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.561505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a8db-a0c4-4562-82d9-397d5167853d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.561785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a8db-a0c4-4562-82d9-397d5167853d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.562055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a8db-a0c4-4562-82d9-397d5167853d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.562782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79a8db-a0c4-4562-82d9-397d5167853d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.564393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79a8db-a0c4-4562-82d9-397d5167853d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.576385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 943/1909] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:52.580673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.590830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c35be-62ee-4e6a-a9d6-0b3acf516688 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.595956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.596831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.597156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.597527 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] PATH_INFO: `/v3/projects/90e0d85e67fa4308afcae3e4a18e8a5c/users/21a9f70a8751413894900546353903aa/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.613015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e0d85e67fa4308afcae3e4a18e8a5c, user_id=21a9f70a8751413894900546353903aa, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.615700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.631332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 967/1910] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:52 2022] PUT /identity/v3/projects/90e0d85e67fa4308afcae3e4a18e8a5c/users/21a9f70a8751413894900546353903aa/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:52.643239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.643526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.643800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.671489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] MFA Rules not processed for user `21a9f70a8751413894900546353903aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:52.672865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:52.747860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 944/1911] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:52.752864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.813986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa153a-0917-497e-ba2e-387e1bf0c848 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.819056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.819729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.820010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.820303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.821017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.822963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.857291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 968/1912] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:52.858808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.869596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f3c92-315b-43a6-83de-b8443c5f06be None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.926523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.927082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.927360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.927629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.928311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.930254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.953303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 945/1913] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:52 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:52.954470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.964886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130344b-73a2-4e59-bd33-278cbbde6523 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:52.969820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:52.970614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:52.971005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:52.971413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:52.972326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:52.974218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:52.984654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 969/1914] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:52.989216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:52.999059 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe4dac-705f-4413-87cc-0c05b21f1caa admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:53.005006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:53.005903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:53.006185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:53.006465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] PATH_INFO: `/v3/projects/ebb13e5f11594974bed7768fbf59cd69/users/cec72178d304483da619012f7395f231/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:53.022745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb13e5f11594974bed7768fbf59cd69, user_id=cec72178d304483da619012f7395f231, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:53.025494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:53.040645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 946/1915] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:52 2022] PUT /identity/v3/projects/ebb13e5f11594974bed7768fbf59cd69/users/cec72178d304483da619012f7395f231/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:53.046553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:53.057136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a339f-f212-45b0-9339-f4e0b07b871f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:53.114928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352529b-5882-4e39-bfb3-0af6eedcca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:53.115586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352529b-5882-4e39-bfb3-0af6eedcca9e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:53.115864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352529b-5882-4e39-bfb3-0af6eedcca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:53.116132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352529b-5882-4e39-bfb3-0af6eedcca9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:53.116842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352529b-5882-4e39-bfb3-0af6eedcca9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:53.118521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352529b-5882-4e39-bfb3-0af6eedcca9e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:53.128674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 970/1916] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:53.132782 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:53.143605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69336365-961c-46bf-ba8a-60691b42cf67 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:53.148712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:53.149716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:53.150060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:53.150403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] PATH_INFO: `/v3/projects/ebb13e5f11594974bed7768fbf59cd69/users/cec72178d304483da619012f7395f231/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:53.152597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb13e5f11594974bed7768fbf59cd69, user_id=cec72178d304483da619012f7395f231, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:53.155293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:53.165887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 947/1917] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:53 2022] PUT /identity/v3/projects/ebb13e5f11594974bed7768fbf59cd69/users/cec72178d304483da619012f7395f231/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:53.176542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:53.176822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:53.177139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:53.203700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] MFA Rules not processed for user `cec72178d304483da619012f7395f231`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:53.205058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:53.276224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 971/1918] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:53.286750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:53.288617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:53.349424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f456e-b8ba-4aa8-895f-522d328fd853 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:53.353338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:53.354017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:53.354294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:53.354567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:53.363858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:53.365334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:53.374632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 948/1919] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:53 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:53.518727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:53.528528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebb0cd-57da-4ee0-aef2-882544c492c1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:53.532039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb8d9d-03b7-4eeb-9a6d-8eb5c43d8815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:53.532682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb8d9d-03b7-4eeb-9a6d-8eb5c43d8815 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:53.532984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb8d9d-03b7-4eeb-9a6d-8eb5c43d8815 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:53.533252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb8d9d-03b7-4eeb-9a6d-8eb5c43d8815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:53.590114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb8d9d-03b7-4eeb-9a6d-8eb5c43d8815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:53.591640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb8d9d-03b7-4eeb-9a6d-8eb5c43d8815 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:53.600582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 972/1920] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:56.691733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:56.693889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:56.797424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0914f2-86fe-4f0b-94f6-34e0a3181a3f service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:56.806736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:56.807905 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:56.808333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:56.808745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] PATH_INFO: `/v3/users/57f4a9df43a4463399059f39e4b85cc4` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:56.810428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f4a9df43a4463399059f39e4b85cc4)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:56.812708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:56.865736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f4a9df43a4463399059f39e4b85cc4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:56.872844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f4a9df43a4463399059f39e4b85cc4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:56.881137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f4a9df43a4463399059f39e4b85cc4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:56.881900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f4a9df43a4463399059f39e4b85cc4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:56.882541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f4a9df43a4463399059f39e4b85cc4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:56.901716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 949/1921] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:56 2022] DELETE /identity/v3/users/57f4a9df43a4463399059f39e4b85cc4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:56.906193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:56.906704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:56.906863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:56.925433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:56.927552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:56.988481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 973/1922] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:56.998302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:56.999749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:57.057151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83a04d-14ea-48ec-b33e-bb52451e96d7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:57.061490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:57.061918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:57.062295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:57.062472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:57.072820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:57.074325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:57.084275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 950/1923] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:57.358150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:57.359597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:57.376820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdd41a-37b8-4977-881c-20a34d7bd5a4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:57.383070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:57.384335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:57.384779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:57.385258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] PATH_INFO: `/v3/projects/faf7b5f717614794974609fd9dff73b5` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:57.386751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf7b5f717614794974609fd9dff73b5)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:57.389704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:57.444692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf7b5f717614794974609fd9dff73b5', 'request_id': 'req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.454300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf7b5f717614794974609fd9dff73b5', 'request_id': 'req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.460538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf7b5f717614794974609fd9dff73b5', 'request_id': 'req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.477395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] The token cache is being invalidate because project faf7b5f717614794974609fd9dff73b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:57.477680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.478417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.480115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 974/1924] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:57 2022] DELETE /identity/v3/projects/faf7b5f717614794974609fd9dff73b5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:57.484358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:57.494558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d4457-865c-4e52-8062-ac60f9d48ade service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:57.553705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:57.554584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:57.554865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:57.555128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] PATH_INFO: `/v3/users/018e36655b584018b100d1c3b543a5c8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:57.556412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=018e36655b584018b100d1c3b543a5c8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:57.558390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:57.613651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018e36655b584018b100d1c3b543a5c8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.621198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018e36655b584018b100d1c3b543a5c8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.629878 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018e36655b584018b100d1c3b543a5c8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.630603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018e36655b584018b100d1c3b543a5c8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.631274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a2b04388-8f88-4467-8129-a866e6ae93eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018e36655b584018b100d1c3b543a5c8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:57.649556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 951/1925] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:10:57 2022] DELETE /identity/v3/users/018e36655b584018b100d1c3b543a5c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:58.015924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.017792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:58.030698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51e64-2ffe-4f5f-90e4-5548b99c085a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.097521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.098428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.098711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.099079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] PATH_INFO: `/v3/projects/8516048972194d80b4cb18cd3230b908` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.100741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8516048972194d80b4cb18cd3230b908)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.102733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.149360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8516048972194d80b4cb18cd3230b908', 'request_id': 'req-e9b5ca07-4984-4300-9cb5-108594502d27'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:58.157216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8516048972194d80b4cb18cd3230b908', 'request_id': 'req-e9b5ca07-4984-4300-9cb5-108594502d27'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:58.164697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8516048972194d80b4cb18cd3230b908', 'request_id': 'req-e9b5ca07-4984-4300-9cb5-108594502d27'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:58.176099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] The token cache is being invalidate because project 8516048972194d80b4cb18cd3230b908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:10:58.176350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:58.177122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e9b5ca07-4984-4300-9cb5-108594502d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:10:58.178919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 975/1926] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:10:58 2022] DELETE /identity/v3/projects/8516048972194d80b4cb18cd3230b908 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:58.184138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.184626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.184835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.203037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:58.204353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:58.272977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 952/1927] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:10:58.282049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.282336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.282613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.302315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:58.303904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:58.312970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 976/1928] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:58.317769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.327489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378595-918c-46fe-9909-7e8de9dc265f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.331939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.332673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.332987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.333258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.334186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:10:58.334481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.336094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.347304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 953/1929] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:10:58.351762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.360856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cb410-9ff1-459f-a341-a81191e8ca85 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.366285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.366940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.367218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.367488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.368174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.370124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.398024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 977/1930] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:58.402114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.414176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560defc-093d-41e7-92b4-d5a17aa3a513 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.475681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.476278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.476541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.476813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.477548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.479463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.501506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 954/1931] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:10:58.505730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.516489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9817ad6-b5f2-4724-8c25-c5c7b2b4cbb9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.521266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.521927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.522210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.522476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.523293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.524879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.535147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 978/1932] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:10:58.539343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.549758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c9c9-cbd8-45ca-aace-9fdcc1d18114 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.555643 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5ded7-ac97-44df-b724-3e03981a0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.556321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ded7-ac97-44df-b724-3e03981a0b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.556602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ded7-ac97-44df-b724-3e03981a0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.556875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ded7-ac97-44df-b724-3e03981a0b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.557636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5ded7-ac97-44df-b724-3e03981a0b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.559282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5ded7-ac97-44df-b724-3e03981a0b45 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.569679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 955/1933] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:58.573886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.584300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff04ba4-3756-44a0-94a4-7e0036a044a1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.590004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.590878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.591157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.591437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] PATH_INFO: `/v3/projects/7e90156ec7d047519985f0fb5dba62e4/users/e3d2be26573d4d6e87976e3414c2a92c/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.607339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e90156ec7d047519985f0fb5dba62e4, user_id=e3d2be26573d4d6e87976e3414c2a92c, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.610076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.626705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 979/1934] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:58 2022] PUT /identity/v3/projects/7e90156ec7d047519985f0fb5dba62e4/users/e3d2be26573d4d6e87976e3414c2a92c/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:58.637127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.637407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.637674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.666511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] MFA Rules not processed for user `e3d2be26573d4d6e87976e3414c2a92c`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:58.668517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:58.748265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 956/1935] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:58.749638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.834404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47bd4-3af7-43a1-882e-d836bea562ee admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.844754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.844754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.844754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.844754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.845185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.845185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.871715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 980/1936] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:58.875559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:58.886558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060074b6-ca51-45aa-9a55-3b2344cd5e2e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:58.959587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:58.960440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:58.960799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:58.961171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:58.962031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:58.964087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:58.995304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 957/1937] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:10:58 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:10:59.000532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:59.012943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f47e4-1460-4770-b50a-02ae088fe905 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:59.020415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:59.021464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.021917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.022394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.023316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:59.025512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:59.041966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 981/1938] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:59.043175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:59.054451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28fc7c-2328-4040-9a5f-7c2f1baa4b84 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:59.061397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:59.062858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.063141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.063420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] PATH_INFO: `/v3/projects/4480c663d1c94e7f8818c82d0fc05200/users/18f5df213ef1422a883c816627d7b49c/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.082253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4480c663d1c94e7f8818c82d0fc05200, user_id=18f5df213ef1422a883c816627d7b49c, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:59.085284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:59.104838 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 958/1939] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:59 2022] PUT /identity/v3/projects/4480c663d1c94e7f8818c82d0fc05200/users/18f5df213ef1422a883c816627d7b49c/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:10:59.108935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:59.122683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7285dea-0e98-4dde-8f99-1bbe4c9a82c4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:59.189699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd9a0c-6cfd-44b8-a266-ac12e3c16617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:59.190782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd9a0c-6cfd-44b8-a266-ac12e3c16617 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.191230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd9a0c-6cfd-44b8-a266-ac12e3c16617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.191660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd9a0c-6cfd-44b8-a266-ac12e3c16617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.192540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd9a0c-6cfd-44b8-a266-ac12e3c16617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:59.194738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd9a0c-6cfd-44b8-a266-ac12e3c16617 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:59.209772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 982/1940] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:10:59.211638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:59.224618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c46c-cc44-458b-95d0-53e229cb6741 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.225019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c46c-cc44-458b-95d0-53e229cb6741 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.225426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c46c-cc44-458b-95d0-53e229cb6741 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.226164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c084f4-5c6e-4eb2-b03e-cc53849540ce admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:59.228519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 983/1941] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:10:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:10:59.232350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33ba2-0a16-4d18-ab08-b17d68494275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:59.233766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33ba2-0a16-4d18-ab08-b17d68494275 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.234233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33ba2-0a16-4d18-ab08-b17d68494275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.234686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33ba2-0a16-4d18-ab08-b17d68494275 admin admin] PATH_INFO: `/v3/projects/4480c663d1c94e7f8818c82d0fc05200/users/18f5df213ef1422a883c816627d7b49c/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.237395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.237541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b33ba2-0a16-4d18-ab08-b17d68494275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4480c663d1c94e7f8818c82d0fc05200, user_id=18f5df213ef1422a883c816627d7b49c, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:59.238219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.238709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.240844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b33ba2-0a16-4d18-ab08-b17d68494275 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:59.262518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:59.265491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:59.269301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 959/1942] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:10:59 2022] PUT /identity/v3/projects/4480c663d1c94e7f8818c82d0fc05200/users/18f5df213ef1422a883c816627d7b49c/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:10:59.270937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.271271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.271546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.314270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] MFA Rules not processed for user `18f5df213ef1422a883c816627d7b49c`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:10:59.316084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:59.370995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 984/1943] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:10:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:59.398730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 960/1944] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:10:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:10:59.403366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:59.404994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:59.409585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:10:59.410995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:10:59.419202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2106dc-70c1-4b17-a062-0c7a09215223 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:59.425411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:59.426271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.426610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.426946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.436379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:59.438093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:59.451013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 985/1945] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:10:59.474987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5c8e-40e9-4ff2-a1c8-86702f77c46a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:10:59.481979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b98736-cf39-4f1e-a97b-788f4b748c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:10:59.482722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b98736-cf39-4f1e-a97b-788f4b748c2e service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:10:59.483072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b98736-cf39-4f1e-a97b-788f4b748c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:10:59.483490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b98736-cf39-4f1e-a97b-788f4b748c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:10:59.496503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b98736-cf39-4f1e-a97b-788f4b748c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:10:59.498005 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b98736-cf39-4f1e-a97b-788f4b748c2e service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:10:59.508671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 961/1946] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:10:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:00.095378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:00.154951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc90f7-a234-4988-bb8e-6a214ecfb6c7 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:00.159496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:00.160381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:00.160662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:00.160942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] PATH_INFO: `/v3/users/e3d2be26573d4d6e87976e3414c2a92c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:00.163233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d2be26573d4d6e87976e3414c2a92c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:00.165184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:00.212249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d2be26573d4d6e87976e3414c2a92c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.220974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d2be26573d4d6e87976e3414c2a92c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.236001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d2be26573d4d6e87976e3414c2a92c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.245094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d2be26573d4d6e87976e3414c2a92c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.245966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d2be26573d4d6e87976e3414c2a92c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.255444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 986/1947] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:00 2022] DELETE /identity/v3/users/e3d2be26573d4d6e87976e3414c2a92c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:00.260033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:00.260495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:00.260583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:00.279692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:00.281335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:00.347495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 962/1948] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:00.357664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:00.359129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:00.457877 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2b69-558b-42a9-874a-1bac45abe03a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:00.461917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:00.462636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:00.462916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:00.463187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:00.473601 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:00.475402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:00.487060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 987/1949] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:00.816509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:00.818447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:00.847327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a46f1-4cf7-4254-a641-9caf8825dbed None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:00.854003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:00.855494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:00.856151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:00.857145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] PATH_INFO: `/v3/projects/7e90156ec7d047519985f0fb5dba62e4` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:00.858668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e90156ec7d047519985f0fb5dba62e4)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:00.861274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:00.922664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e90156ec7d047519985f0fb5dba62e4', 'request_id': 'req-98986e31-53aa-4087-b909-84bdb925a44a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.930938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e90156ec7d047519985f0fb5dba62e4', 'request_id': 'req-98986e31-53aa-4087-b909-84bdb925a44a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.938146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e90156ec7d047519985f0fb5dba62e4', 'request_id': 'req-98986e31-53aa-4087-b909-84bdb925a44a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.948846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] The token cache is being invalidate because project 7e90156ec7d047519985f0fb5dba62e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:00.949159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.949959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:00.951495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 963/1950] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:00 2022] DELETE /identity/v3/projects/7e90156ec7d047519985f0fb5dba62e4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:00.955469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:00.966270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0b2f-3c13-4fcb-aea1-d4d5a61a32d9 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:01.021345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:01.022210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.022632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.022794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] PATH_INFO: `/v3/users/18f5df213ef1422a883c816627d7b49c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.024077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f5df213ef1422a883c816627d7b49c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:01.026174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:01.077610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f5df213ef1422a883c816627d7b49c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.084452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f5df213ef1422a883c816627d7b49c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.097343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f5df213ef1422a883c816627d7b49c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.106277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f5df213ef1422a883c816627d7b49c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.106992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dd7e72bf-9116-4645-81ea-b74dbbae0a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f5df213ef1422a883c816627d7b49c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.112791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 988/1951] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:00 2022] DELETE /identity/v3/users/18f5df213ef1422a883c816627d7b49c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:01.445940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:01.448057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:01.463562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986e31-53aa-4087-b909-84bdb925a44a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:01.529556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:01.530466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.530932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.531122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] PATH_INFO: `/v3/projects/4480c663d1c94e7f8818c82d0fc05200` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.533111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4480c663d1c94e7f8818c82d0fc05200)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:01.535250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:01.599971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4480c663d1c94e7f8818c82d0fc05200', 'request_id': 'req-b48322e5-57a7-4c0d-9f8f-986e28c846ed'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.609354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4480c663d1c94e7f8818c82d0fc05200', 'request_id': 'req-b48322e5-57a7-4c0d-9f8f-986e28c846ed'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.620074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4480c663d1c94e7f8818c82d0fc05200', 'request_id': 'req-b48322e5-57a7-4c0d-9f8f-986e28c846ed'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.633450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] The token cache is being invalidate because project 4480c663d1c94e7f8818c82d0fc05200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:01.633798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.634494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b48322e5-57a7-4c0d-9f8f-986e28c846ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:01.640549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 964/1952] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:01 2022] DELETE /identity/v3/projects/4480c663d1c94e7f8818c82d0fc05200 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:01.641561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.642091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.642600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.662398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:01.663957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:01.740267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 989/1953] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:01.748230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.748518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.748826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.771763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:01.773143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:01.781940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 965/1954] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:01.787092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:01.798477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e551d-857d-410f-be4d-76cfe3e13049 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:01.804538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:01.805623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.806118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.806604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.807525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:01.808010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:01.812295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:01.826175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 990/1955] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:01.830718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:01.840991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d582d8-8d8a-4f3c-b562-14297d36e35f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:01.849227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:01.850174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.850657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.851132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.852235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:01.856247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:01.894408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 966/1956] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:01 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:01.902046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:01.922291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09085cf-8ae5-4f8c-8c5d-ae35b064cd20 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:01.985394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:01.986076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:01.986556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:01.986740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:01.987435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:01.989450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.012478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 991/1957] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:01 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:02.017641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.029468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f2af-c18e-4b6d-a788-168af0290aba admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.034251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.034935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.035236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.035486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.036218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.038037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.049083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 967/1958] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:02.053847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.072139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ce4e-4e7c-4fb7-899f-0e86ad4599ec admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.084521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e726d-a59b-4a24-89c6-b1490c8b1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.085220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e726d-a59b-4a24-89c6-b1490c8b1b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.085616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e726d-a59b-4a24-89c6-b1490c8b1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.085958 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e726d-a59b-4a24-89c6-b1490c8b1b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.086857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e726d-a59b-4a24-89c6-b1490c8b1b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.088583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e726d-a59b-4a24-89c6-b1490c8b1b73 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.110614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 992/1959] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:02.111561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.127665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124d41c-8524-4678-9b2f-b0995808cfe9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.132771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.133764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.134045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.134324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] PATH_INFO: `/v3/projects/ef4b8fbc23f64e5eb84517aa289e71b1/users/353445975d5e444bb3ce55f9d761d4b3/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.151555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4b8fbc23f64e5eb84517aa289e71b1, user_id=353445975d5e444bb3ce55f9d761d4b3, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.154688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.176303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 968/1960] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:02 2022] PUT /identity/v3/projects/ef4b8fbc23f64e5eb84517aa289e71b1/users/353445975d5e444bb3ce55f9d761d4b3/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:02.182687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.183422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.183777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.216754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:02.218399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:02.298407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 993/1961] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:02.309014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.310950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:02.328742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.330301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:02.344061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca981-b0e0-4101-80cd-5ad8ff1180a3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.349567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.350616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.350896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.351172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] PATH_INFO: `/v3/users/513edb4fd6fb484894ad7dfeae4d43aa` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.352462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513edb4fd6fb484894ad7dfeae4d43aa)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.354440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.377914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da43b8-1741-4f0b-b80c-45a25dc8a200 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.383179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989742c0-8a55-4b51-8b0e-52a56a3d9cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.383984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989742c0-8a55-4b51-8b0e-52a56a3d9cba service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.384245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989742c0-8a55-4b51-8b0e-52a56a3d9cba service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.384510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989742c0-8a55-4b51-8b0e-52a56a3d9cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.396995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989742c0-8a55-4b51-8b0e-52a56a3d9cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.398717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989742c0-8a55-4b51-8b0e-52a56a3d9cba service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.407762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513edb4fd6fb484894ad7dfeae4d43aa'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:02.409532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 969/1962] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:02.414580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513edb4fd6fb484894ad7dfeae4d43aa'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:02.429819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513edb4fd6fb484894ad7dfeae4d43aa'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:02.440257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513edb4fd6fb484894ad7dfeae4d43aa'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:02.441036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513edb4fd6fb484894ad7dfeae4d43aa'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:02.448233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 994/1963] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:02 2022] DELETE /identity/v3/users/513edb4fd6fb484894ad7dfeae4d43aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:02.452790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.453307 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.453577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.471791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:02.473131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:02.533684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 970/1964] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:02.543910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.545453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:02.607043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec9d1-4972-4887-a559-5b329ed7c662 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.610922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.611578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.611859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.612134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.623243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.624987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:02.644985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 995/1965] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:02.965791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:02.967455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:02.982029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77340b-ac93-4870-bd3e-68e00b6e299e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:02.991087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:02.992272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:02.992732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:02.993297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] PATH_INFO: `/v3/projects/a9cda548b9d04c67b5036c98a05574d7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:02.994852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cda548b9d04c67b5036c98a05574d7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:02.996786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:03.056403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cda548b9d04c67b5036c98a05574d7', 'request_id': 'req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.077184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cda548b9d04c67b5036c98a05574d7', 'request_id': 'req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.090013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cda548b9d04c67b5036c98a05574d7', 'request_id': 'req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.109420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] The token cache is being invalidate because project a9cda548b9d04c67b5036c98a05574d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:03.109710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.113064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.115050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 971/1966] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:02 2022] DELETE /identity/v3/projects/a9cda548b9d04c67b5036c98a05574d7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:03.119213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:03.132815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc688-da70-41c8-be94-a1a947467f8b service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:03.226138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:03.227765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:03.228309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:03.228766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] PATH_INFO: `/v3/users/defaa61ef90c4689b42e3fdb9b7a5166` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:03.230677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defaa61ef90c4689b42e3fdb9b7a5166)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:03.233022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:03.311121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defaa61ef90c4689b42e3fdb9b7a5166'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.324414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:03.325657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defaa61ef90c4689b42e3fdb9b7a5166'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.326987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:03.342810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defaa61ef90c4689b42e3fdb9b7a5166'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.347157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ea0f-b06b-4e49-8ea8-3335b85506c5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:03.353426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:03.354854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:03.355215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defaa61ef90c4689b42e3fdb9b7a5166'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.355566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:03.355981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b3ff34d7-d9d9-48ea-8d6e-0847f7ee3499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defaa61ef90c4689b42e3fdb9b7a5166'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.356432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] PATH_INFO: `/v3/users/b1de23ff5ab84b81b04bdceb4bc8780e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:03.358077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1de23ff5ab84b81b04bdceb4bc8780e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:03.360284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:03.373366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 996/1967] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:03 2022] DELETE /identity/v3/users/defaa61ef90c4689b42e3fdb9b7a5166 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:03.454339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1de23ff5ab84b81b04bdceb4bc8780e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.488243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1de23ff5ab84b81b04bdceb4bc8780e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.502756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1de23ff5ab84b81b04bdceb4bc8780e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.504844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1de23ff5ab84b81b04bdceb4bc8780e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.527437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dfab8dd4-690f-4f43-853f-ceca0cf948f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1de23ff5ab84b81b04bdceb4bc8780e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:03.586414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:03.586717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:03.586983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:03.593672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 972/1968] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:03 2022] DELETE /identity/v3/users/b1de23ff5ab84b81b04bdceb4bc8780e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:03.595870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:03.596374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:03.596969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:03.619331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:03.621049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:03.703687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] MFA Rules not processed for user `353445975d5e444bb3ce55f9d761d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:03.705357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:03.775426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 973/1969] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:03.790219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:03.793415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:03.899021 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 997/1970] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:03.900402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:03.901953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:03.914923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59758c65-99db-4cba-8f9b-8197336367a6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:03.921406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257511f-aada-416f-a776-058713039dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:03.922576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257511f-aada-416f-a776-058713039dcd service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:03.923120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257511f-aada-416f-a776-058713039dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:03.923624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257511f-aada-416f-a776-058713039dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:03.936659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257511f-aada-416f-a776-058713039dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:03.939292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51c69-01ac-4288-bc96-2a7d008e8d75 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:03.939461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257511f-aada-416f-a776-058713039dcd service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:03.950161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:03.951147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:03.951491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:03.951856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] PATH_INFO: `/v3/projects/8b5029964de94e96b8755556e16bd737` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:03.954646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5029964de94e96b8755556e16bd737)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:03.956851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:03.958940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 974/1971] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:03.961463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257511f-aada-416f-a776-058713039dcd service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:03.962910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7257511f-aada-416f-a776-058713039dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.034910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5029964de94e96b8755556e16bd737', 'request_id': 'req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.049771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5029964de94e96b8755556e16bd737', 'request_id': 'req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.052990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257511f-aada-416f-a776-058713039dcd service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.059310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5029964de94e96b8755556e16bd737', 'request_id': 'req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.072388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] The token cache is being invalidate because project 8b5029964de94e96b8755556e16bd737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:04.073013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.074036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8eb2c536-b955-45a8-be97-d27fb4ac2bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.076041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 998/1972] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:03 2022] DELETE /identity/v3/projects/8b5029964de94e96b8755556e16bd737 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:04.083809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd488a3-399f-4ee4-bad2-b26e9c23bab6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.084277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd488a3-399f-4ee4-bad2-b26e9c23bab6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.084610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd488a3-399f-4ee4-bad2-b26e9c23bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.107670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-edd488a3-399f-4ee4-bad2-b26e9c23bab6 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:04.109290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-edd488a3-399f-4ee4-bad2-b26e9c23bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.120850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.122452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.122814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.123161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.126347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.198980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 999/1973] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:04.201064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.201394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.201703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.221791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.223556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.235696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 975/1974] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:04.240503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:04.241879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.252944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1000/1975] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:04.257975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.280134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6ac54-30f9-480c-9264-ff6840f8bfde service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.288945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.289777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.290077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.290433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.293499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:04.293891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.299126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.337224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 976/1976] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:04.342204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.370584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1770-01f0-4d49-9f50-9809d188f07f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.377079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.377502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.378346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.378623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.379328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.381514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.383590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.386077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.403152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaa6c8-eee8-4bbb-9fae-e8a03a2624ca admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.409528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.410812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.411368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.412022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] PATH_INFO: `/v3/users/21a9f70a8751413894900546353903aa` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.413886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a9f70a8751413894900546353903aa)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.416098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.421389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1001/1977] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:04 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:04.425835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.504120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01c334-15fb-47d0-888c-c100a8b8673b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.509986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.510670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.511102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.511554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.512649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.515150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.526489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a9f70a8751413894900546353903aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.547197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1002/1978] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:04 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:04.548275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.549983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a9f70a8751413894900546353903aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.562197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.577591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a9f70a8751413894900546353903aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.578963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a9f70a8751413894900546353903aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.579554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e5c3-62a3-44b9-a797-90c0fd0b9e32 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.581228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a9f70a8751413894900546353903aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.591420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.592490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.592835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.593187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] PATH_INFO: `/v3/projects/ec228322d46643e5a590546277283a02` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.595538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec228322d46643e5a590546277283a02)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.597946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.629098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 977/1979] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:04 2022] DELETE /identity/v3/users/21a9f70a8751413894900546353903aa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:04.633896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.640277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.701449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec228322d46643e5a590546277283a02', 'request_id': 'req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.717213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec228322d46643e5a590546277283a02', 'request_id': 'req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.727361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec228322d46643e5a590546277283a02', 'request_id': 'req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.743784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] The token cache is being invalidate because project ec228322d46643e5a590546277283a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:04.744086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.745096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b0360c4e-83c6-47fe-bf65-15b1a6bc09b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:04.747289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1003/1980] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:04 2022] DELETE /identity/v3/projects/ec228322d46643e5a590546277283a02 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:04.748665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.749026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.749308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.756781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b9624-92ff-4c71-a75a-077aab65bf08 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.783854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:04.787113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.831086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.832032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.832032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.832313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.833289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.835257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.865573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 978/1981] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:04.866895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.874673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.896721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1532e-50df-4fd3-bf89-87709e13166c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:04.908000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:04.908987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:04.909274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:04.909597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] PATH_INFO: `/v3/users/ad4c82bef19147b39c7b42cf30ff9356` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:04.911293 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4c82bef19147b39c7b42cf30ff9356)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:04.913381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:04.977451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1004/1982] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:04.978722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:04.980331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:04.993424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08174c88-0dda-4918-b959-6a51c1ad0854 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:05.001223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:05.002551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.003194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.003627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.004854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:05.008009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:05.011990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4c82bef19147b39c7b42cf30ff9356'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.021840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4c82bef19147b39c7b42cf30ff9356'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.027829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1005/1983] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:05.028389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:05.030423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.043716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4c82bef19147b39c7b42cf30ff9356'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.044727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4c82bef19147b39c7b42cf30ff9356'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.046007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4c82bef19147b39c7b42cf30ff9356'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.069060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 979/1984] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:04 2022] DELETE /identity/v3/users/ad4c82bef19147b39c7b42cf30ff9356 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:05.078184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:05.085888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.136487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317897c3-d268-4ddb-90e0-f6985b09a4e3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:05.231987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332e3c-c244-4648-bec6-d8029b35d5da admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:05.243372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:05.244334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.244758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.245150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] PATH_INFO: `/v3/projects/a047490cf14e4ecf8285f0e3a9b551bb/users/f847040c052844aeaa0454364509d929/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.250064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:05.250738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.251014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.251278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.257932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.275247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:05.278111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556632e2-afa5-4de6-80a0-ea46927418b8 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:05.280448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a047490cf14e4ecf8285f0e3a9b551bb, user_id=f847040c052844aeaa0454364509d929, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:05.283331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:05.313534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1006/1985] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:05.329000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 980/1986] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:05 2022] PUT /identity/v3/projects/a047490cf14e4ecf8285f0e3a9b551bb/users/f847040c052844aeaa0454364509d929/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:05.331627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.332856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.333501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.415765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] MFA Rules not processed for user `f847040c052844aeaa0454364509d929`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:05.417045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.516943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1007/1987] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:05.526680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:05.528566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.596458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f7848-8e30-475c-9d6c-bb545d1a5c02 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:05.600641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca630d-c803-436d-9c45-57353f329f6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:05.601598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca630d-c803-436d-9c45-57353f329f6d service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.602096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca630d-c803-436d-9c45-57353f329f6d service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.602593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca630d-c803-436d-9c45-57353f329f6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.618774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca630d-c803-436d-9c45-57353f329f6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:05.619047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:05.620635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.621180 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca630d-c803-436d-9c45-57353f329f6d service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:05.650326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 981/1988] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:05.731316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff62b-7343-48e8-acd9-82c170f42d62 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:05.740185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:05.742772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.743195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.743910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] PATH_INFO: `/v3/projects/8fa17457367742f89f6344830b34dc5f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.747852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa17457367742f89f6344830b34dc5f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:05.759653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:05.765613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfcae6-0ab0-478a-a67a-365762e4debe None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.766029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfcae6-0ab0-478a-a67a-365762e4debe None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.766416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfcae6-0ab0-478a-a67a-365762e4debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.797884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f4cfcae6-0ab0-478a-a67a-365762e4debe None None] MFA Rules not processed for user `353445975d5e444bb3ce55f9d761d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:05.799485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f4cfcae6-0ab0-478a-a67a-365762e4debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.874662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa17457367742f89f6344830b34dc5f', 'request_id': 'req-86a77d09-219d-4d95-a0ef-d255b1fe89de'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.886497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa17457367742f89f6344830b34dc5f', 'request_id': 'req-86a77d09-219d-4d95-a0ef-d255b1fe89de'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.895121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa17457367742f89f6344830b34dc5f', 'request_id': 'req-86a77d09-219d-4d95-a0ef-d255b1fe89de'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.911152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] The token cache is being invalidate because project 8fa17457367742f89f6344830b34dc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:05.912297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.913368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:05.916879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1008/1989] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:05 2022] DELETE /identity/v3/projects/8fa17457367742f89f6344830b34dc5f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:05.917867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:05.919524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:05.941731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 982/1990] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:05.943138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c642-5e90-491d-a572-abe84997fb44 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:05.943462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c642-5e90-491d-a572-abe84997fb44 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:05.943808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c642-5e90-491d-a572-abe84997fb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:05.965886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0d77c642-5e90-491d-a572-abe84997fb44 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:05.967669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0d77c642-5e90-491d-a572-abe84997fb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:06.064633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a77d09-219d-4d95-a0ef-d255b1fe89de admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.072028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.073472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.073844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.074179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] PATH_INFO: `/v3/projects/90e0d85e67fa4308afcae3e4a18e8a5c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.075517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e0d85e67fa4308afcae3e4a18e8a5c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.079046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.104756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 983/1991] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:06.114653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.115867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.116319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.145969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:06.149140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:06.169616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e0d85e67fa4308afcae3e4a18e8a5c', 'request_id': 'req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.179318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e0d85e67fa4308afcae3e4a18e8a5c', 'request_id': 'req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.190226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e0d85e67fa4308afcae3e4a18e8a5c', 'request_id': 'req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.205495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] The token cache is being invalidate because project 90e0d85e67fa4308afcae3e4a18e8a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:06.206397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.207386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.209941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1009/1992] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:05 2022] DELETE /identity/v3/projects/90e0d85e67fa4308afcae3e4a18e8a5c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:06.214103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.216345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:06.247348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 984/1993] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:06.251526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.267325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c15a-14f2-470a-a28e-94cdf6771c7d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.276126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.277379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.277379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.277573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.278182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:06.278571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.280295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.311857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a1f4-c6c7-4a0a-a184-dde6f90cc230 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.318057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.319272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.319928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.320130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] PATH_INFO: `/v3/users/cec72178d304483da619012f7395f231` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.321649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec72178d304483da619012f7395f231)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.324328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.328163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 985/1994] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:11:06.331347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.351417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ee2b9-bd3a-412d-8cf5-46751ec355b7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.371941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.375216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.375216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.377486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.379087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.382462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.414587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec72178d304483da619012f7395f231'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.435477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec72178d304483da619012f7395f231'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.451090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 986/1995] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:06 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:06.452703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.461162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec72178d304483da619012f7395f231'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.485839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec72178d304483da619012f7395f231'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.486898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec72178d304483da619012f7395f231'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:06.494674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1010/1996] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:06 2022] DELETE /identity/v3/users/cec72178d304483da619012f7395f231 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:06.611491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05efda-56f5-4ae9-aefd-9e13c2aad9f4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.672763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.673546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.673898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.674243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.675040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.677541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.706069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 987/1997] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:06 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:06.709937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.711681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:06.726391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3fcf-5ec4-43cc-9a66-a95e201df41e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.746811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.747932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.748421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.750355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.751928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.756092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.772496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1011/1998] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:06.776335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.788410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491904bb-f4b5-445c-88dd-384f746340db admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.793921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f5ec0-873b-40a9-b9b1-50c209cdd6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.794597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5ec0-873b-40a9-b9b1-50c209cdd6ac admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.795066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5ec0-873b-40a9-b9b1-50c209cdd6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.795248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5ec0-873b-40a9-b9b1-50c209cdd6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.796039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f5ec0-873b-40a9-b9b1-50c209cdd6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.797948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f5ec0-873b-40a9-b9b1-50c209cdd6ac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.817043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 988/1999] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:06.818469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:06.828854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860891-b5e5-4368-bcdc-95df3dddc8bb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:06.833687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:06.834582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.834865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.835143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] PATH_INFO: `/v3/projects/5252180128664b20b9f5a43a731a7863/users/654920d8f2b74f0aa5e0691c5b233e89/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.851286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5252180128664b20b9f5a43a731a7863, user_id=654920d8f2b74f0aa5e0691c5b233e89, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:06.853988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:06.879915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1012/2000] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:06 2022] PUT /identity/v3/projects/5252180128664b20b9f5a43a731a7863/users/654920d8f2b74f0aa5e0691c5b233e89/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:06.881840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:06.882244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:06.882599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:06.915847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] MFA Rules not processed for user `654920d8f2b74f0aa5e0691c5b233e89`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:06.917402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:07.025154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 989/2001] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:07.031024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.118662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681668f-4e68-4408-90bc-5ccc971d2f63 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.124776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.125480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.125692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.126031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.126653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.129225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.175933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1013/2002] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:07 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:07.180249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.192288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173b1b-0289-48ef-9148-d514bf8ac269 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.294529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.296296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:07.309317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.331557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.332249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.332705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.335079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.338204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.375774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 990/2003] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:07 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:07.379589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.409624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dbe11-f78f-4f59-b46e-af1ccb5e0d6b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.422233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.422915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.423193 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.423463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.424194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.429830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.435562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae269a1e-4005-46ba-81fe-9d760f982830 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.441600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.442796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.443235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.443511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] PATH_INFO: `/v3/projects/ebb13e5f11594974bed7768fbf59cd69` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.446510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb13e5f11594974bed7768fbf59cd69)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.449318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.453146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 991/2004] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:07.454542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.472611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545778f-6401-4247-85e8-af58ea884bd5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.482854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.485015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.485015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.485323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] PATH_INFO: `/v3/projects/a5a36eb12b234c73815bfb4eed59c9e0/users/9fbf189e7a254a8d827d045725703c6c/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.516030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a36eb12b234c73815bfb4eed59c9e0, user_id=9fbf189e7a254a8d827d045725703c6c, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.520000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.539254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb13e5f11594974bed7768fbf59cd69', 'request_id': 'req-72efd19d-9322-4388-8b94-48d124ffd997'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:07.555159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 992/2005] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:07 2022] PUT /identity/v3/projects/a5a36eb12b234c73815bfb4eed59c9e0/users/9fbf189e7a254a8d827d045725703c6c/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:07.559592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb13e5f11594974bed7768fbf59cd69', 'request_id': 'req-72efd19d-9322-4388-8b94-48d124ffd997'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:07.560267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.565769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb13e5f11594974bed7768fbf59cd69', 'request_id': 'req-72efd19d-9322-4388-8b94-48d124ffd997'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:07.579187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] The token cache is being invalidate because project ebb13e5f11594974bed7768fbf59cd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:07.580110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:07.580453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-72efd19d-9322-4388-8b94-48d124ffd997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:07.590879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1014/2006] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:07 2022] DELETE /identity/v3/projects/ebb13e5f11594974bed7768fbf59cd69 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:07.613455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a43a-5608-4b03-8dfd-c7b8bbd3807e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.615478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a43a-5608-4b03-8dfd-c7b8bbd3807e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.615840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a43a-5608-4b03-8dfd-c7b8bbd3807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.660454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d5f5a43a-5608-4b03-8dfd-c7b8bbd3807e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:07.662182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5f5a43a-5608-4b03-8dfd-c7b8bbd3807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:07.673434 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea7c84-1bfb-48e8-b1e8-c70b6c26d5fa admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.680190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.680891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.681264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.681577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.682559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.689141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1015/2007] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:07.689336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.691559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.692030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.698489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 993/2008] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:07.703633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.703743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.707025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:07.745680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e37a8-5ec2-4f60-91db-3ba7f3473e08 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.754014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:07.759036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:07.761694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281df5f-9b79-481d-aebb-53a345ef8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.762815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281df5f-9b79-481d-aebb-53a345ef8ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.764392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281df5f-9b79-481d-aebb-53a345ef8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.765276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281df5f-9b79-481d-aebb-53a345ef8ccf admin admin] PATH_INFO: `/v3/projects/a5a36eb12b234c73815bfb4eed59c9e0/users/9fbf189e7a254a8d827d045725703c6c/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.769922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281df5f-9b79-481d-aebb-53a345ef8ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a36eb12b234c73815bfb4eed59c9e0, user_id=9fbf189e7a254a8d827d045725703c6c, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.777841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281df5f-9b79-481d-aebb-53a345ef8ccf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.795613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1016/2009] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:07.812125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 994/2010] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:07 2022] PUT /identity/v3/projects/a5a36eb12b234c73815bfb4eed59c9e0/users/9fbf189e7a254a8d827d045725703c6c/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:07.819669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.822396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.822688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.822969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.832592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdc8b-36fc-4802-8751-3bb77609f2f7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:07.871639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] MFA Rules not processed for user `9fbf189e7a254a8d827d045725703c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:07.873837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:07.963049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:07.963263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:07.963590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:07.963869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:07.964606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:07.964940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:07.966798 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:07.978955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1017/2011] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:07.983125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:07.990136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 995/2012] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:07.996155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635b9ba-fd87-428c-bd81-1ec5ff1cc7ad admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.001120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.002030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.002483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:08.002882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.003254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.003953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.004944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.011384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.040136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1018/2013] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:07 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:08.044666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.078857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eeb722-c0e5-42b6-9a40-64a20fdd6e39 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.118598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11e5d-f7d0-4d59-928d-67172bedbedf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.124893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.125696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.125974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.126251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.128047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.140664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.150799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d692-bed4-437d-a3f2-dea114f9dbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.151474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d692-bed4-437d-a3f2-dea114f9dbbd service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.151757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d692-bed4-437d-a3f2-dea114f9dbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.152027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d692-bed4-437d-a3f2-dea114f9dbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.167845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1019/2014] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:08 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:08.171553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.194317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f8c5-c87d-46bf-9aee-f33e77fd4e64 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.202243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.203155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.203789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.204524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.205483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.207539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.220702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1020/2015] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:08.224738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.235231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2215-0528-4221-936a-cb069f98ef3b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.240572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.241566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.241992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.242434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.243384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.245275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.257117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1021/2016] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:08.261704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.265532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d692-bed4-437d-a3f2-dea114f9dbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.266995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d692-bed4-437d-a3f2-dea114f9dbbd service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.274123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20a301-9c66-4ba5-81a7-52b5abe60bfc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.279391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.281137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.281432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.281710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] PATH_INFO: `/v3/projects/e360993f081f4906b9d137a3a03fc294/users/e0e39049db9f4d1d80c96f75555acfae/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.282828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 996/2017] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:08.303517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e360993f081f4906b9d137a3a03fc294, user_id=e0e39049db9f4d1d80c96f75555acfae, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.306499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.322476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1022/2018] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:08 2022] PUT /identity/v3/projects/e360993f081f4906b9d137a3a03fc294/users/e0e39049db9f4d1d80c96f75555acfae/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:08.334755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.335039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.335309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.372528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] MFA Rules not processed for user `e0e39049db9f4d1d80c96f75555acfae`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:08.374001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:08.389463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.464522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 997/2019] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:08.469227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.470639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40197a7-cd04-4d64-9897-8969ff70d3cf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.477945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.478761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.479140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.479515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.481658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:08.559980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5aab2-16df-424f-8aca-ba8ac79513e6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.565140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.565890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.566239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.566581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.567416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.569823 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.570608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.572285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.583502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1023/2020] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:08.608846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 998/2021] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:08 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:08.613058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.625579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0aaf-fb16-4c60-a592-104de513b734 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.699487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.700234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.700562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.700746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.701570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.703442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.743252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1024/2022] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:08 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:08.744555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.756436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed27802-80cf-462f-80ed-39e6e5b9c9fc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.761911 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.762719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.762915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.763329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.764489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.766620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.784953 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 999/2023] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:08.790356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.810909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a6a1-379e-4bce-97dd-19bebce2bf95 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:08.828936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:08.830007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:08.831332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:08.831913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] PATH_INFO: `/v3/projects/f2ac7bd0ee7442419fcefa9b523f5397/users/5756ee5a17ee4e2fb31661aed1ad39f0/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:08.878216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ac7bd0ee7442419fcefa9b523f5397, user_id=5756ee5a17ee4e2fb31661aed1ad39f0, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:08.881589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:08.920694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1025/2024] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:08 2022] PUT /identity/v3/projects/f2ac7bd0ee7442419fcefa9b523f5397/users/5756ee5a17ee4e2fb31661aed1ad39f0/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:08.925091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:08.948842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c77db3-9d75-4513-92f8-058b65f0c5e9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:09.054266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fa766-442c-4e5e-860e-2bf7d8fb5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:09.054266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fa766-442c-4e5e-860e-2bf7d8fb5443 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:09.054266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fa766-442c-4e5e-860e-2bf7d8fb5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:09.054712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fa766-442c-4e5e-860e-2bf7d8fb5443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:09.055340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fa766-442c-4e5e-860e-2bf7d8fb5443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:09.059200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fa766-442c-4e5e-860e-2bf7d8fb5443 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:09.090564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:09.093091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1000/2025] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:09.106382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d5211-75dd-4333-9173-9ed537cbc746 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:09.115931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:09.116993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:09.117279 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:09.117621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] PATH_INFO: `/v3/projects/f2ac7bd0ee7442419fcefa9b523f5397/users/5756ee5a17ee4e2fb31661aed1ad39f0/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:09.121012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ac7bd0ee7442419fcefa9b523f5397, user_id=5756ee5a17ee4e2fb31661aed1ad39f0, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:09.123077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:09.141550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1026/2026] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:09 2022] PUT /identity/v3/projects/f2ac7bd0ee7442419fcefa9b523f5397/users/5756ee5a17ee4e2fb31661aed1ad39f0/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:09.152704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:09.153030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:09.153294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:09.205302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] MFA Rules not processed for user `5756ee5a17ee4e2fb31661aed1ad39f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:09.207017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:09.297159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1001/2027] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:09.305471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:09.376564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e45ce-1b35-4794-aa3e-6ea9ae166a1c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:09.381425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:09.382292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:09.383964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:09.384513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:09.406115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:09.407648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:09.419437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1027/2028] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:09.525943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:09.537337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e25ce-5fce-4939-ae16-5ecfdae74e59 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:09.541771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cef35-5d32-4ea1-8587-2e943fa2ced9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:09.542446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cef35-5d32-4ea1-8587-2e943fa2ced9 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:09.542729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cef35-5d32-4ea1-8587-2e943fa2ced9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:09.543028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cef35-5d32-4ea1-8587-2e943fa2ced9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:09.651965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cef35-5d32-4ea1-8587-2e943fa2ced9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:09.653191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cef35-5d32-4ea1-8587-2e943fa2ced9 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:09.663966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1002/2029] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:10.024352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:10.106092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537babf-5eec-43b8-b2b9-95029e6130cf service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:10.111703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:10.112602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:10.112885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:10.113233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] PATH_INFO: `/v3/users/e0e39049db9f4d1d80c96f75555acfae` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:10.115195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e39049db9f4d1d80c96f75555acfae)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:10.117201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:10.199049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e39049db9f4d1d80c96f75555acfae'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.207141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e39049db9f4d1d80c96f75555acfae'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.221765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e39049db9f4d1d80c96f75555acfae'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.233633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e39049db9f4d1d80c96f75555acfae'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.234442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e39049db9f4d1d80c96f75555acfae'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.244331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1028/2030] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:10 2022] DELETE /identity/v3/users/e0e39049db9f4d1d80c96f75555acfae => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:10.249034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:10.249933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:10.250369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:10.274641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:10.276613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:10.362818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1003/2031] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:10.373727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:10.375573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:10.446984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ace8a-363b-4d32-9c62-46443003a156 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:10.452913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:10.453930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:10.454218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:10.454482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:10.467960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:10.469633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:10.484816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1029/2032] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:10.803885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:10.810233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:10.850275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0867b-d514-48e1-85dd-22a8e33a6ef1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:10.857528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:10.858611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:10.859051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:10.859512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] PATH_INFO: `/v3/projects/e360993f081f4906b9d137a3a03fc294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:10.860862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e360993f081f4906b9d137a3a03fc294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:10.863762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:10.945668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e360993f081f4906b9d137a3a03fc294', 'request_id': 'req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.969009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e360993f081f4906b9d137a3a03fc294', 'request_id': 'req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.978493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e360993f081f4906b9d137a3a03fc294', 'request_id': 'req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.997101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] The token cache is being invalidate because project e360993f081f4906b9d137a3a03fc294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:10.997933 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:10.998867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.003424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1004/2033] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:10 2022] DELETE /identity/v3/projects/e360993f081f4906b9d137a3a03fc294 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:11.004966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.016146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eb810-6758-476b-a841-fdf400740eba service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:11.087809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:11.088723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.089037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.089358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] PATH_INFO: `/v3/users/5756ee5a17ee4e2fb31661aed1ad39f0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.090655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5756ee5a17ee4e2fb31661aed1ad39f0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:11.094391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:11.162313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5756ee5a17ee4e2fb31661aed1ad39f0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.170189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5756ee5a17ee4e2fb31661aed1ad39f0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.183814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5756ee5a17ee4e2fb31661aed1ad39f0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.191928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5756ee5a17ee4e2fb31661aed1ad39f0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.193404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5756ee5a17ee4e2fb31661aed1ad39f0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.199687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1030/2034] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:11 2022] DELETE /identity/v3/users/5756ee5a17ee4e2fb31661aed1ad39f0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:11.379022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.381694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:11.397220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a9fb3-0154-4866-9dce-f1aa8f8b12f1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:11.469584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:11.470951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.470951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.476354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] PATH_INFO: `/v3/users/654920d8f2b74f0aa5e0691c5b233e89` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.477776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=654920d8f2b74f0aa5e0691c5b233e89)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:11.479734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:11.520867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.522967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:11.540345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f5911-0139-4f52-ae01-a1db36f1c053 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:11.546347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:11.547244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.547528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.547809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] PATH_INFO: `/v3/projects/f2ac7bd0ee7442419fcefa9b523f5397` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.549089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ac7bd0ee7442419fcefa9b523f5397)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:11.551387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:11.584626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654920d8f2b74f0aa5e0691c5b233e89'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.594651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654920d8f2b74f0aa5e0691c5b233e89'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.604635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ac7bd0ee7442419fcefa9b523f5397', 'request_id': 'req-98cdffb3-4917-47c2-8cfe-2088444a7cdc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.605799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654920d8f2b74f0aa5e0691c5b233e89'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.606589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654920d8f2b74f0aa5e0691c5b233e89'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.607744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4532f5ed-ac24-407b-afe9-54d9ba3fd3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654920d8f2b74f0aa5e0691c5b233e89'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.613091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ac7bd0ee7442419fcefa9b523f5397', 'request_id': 'req-98cdffb3-4917-47c2-8cfe-2088444a7cdc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.619538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ac7bd0ee7442419fcefa9b523f5397', 'request_id': 'req-98cdffb3-4917-47c2-8cfe-2088444a7cdc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.631622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] The token cache is being invalidate because project f2ac7bd0ee7442419fcefa9b523f5397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:11.631914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.632554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98cdffb3-4917-47c2-8cfe-2088444a7cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:11.634793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1031/2036] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:11 2022] DELETE /identity/v3/projects/f2ac7bd0ee7442419fcefa9b523f5397 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:11.636462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1005/2036] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:11 2022] DELETE /identity/v3/users/654920d8f2b74f0aa5e0691c5b233e89 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:11.640546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.640698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617027-9b66-4798-a09a-088ece8af961 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.640698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617027-9b66-4798-a09a-088ece8af961 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.640843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.640947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617027-9b66-4798-a09a-088ece8af961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.641043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.658587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:11.659830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:11.665716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ea617027-9b66-4798-a09a-088ece8af961 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:11.666948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ea617027-9b66-4798-a09a-088ece8af961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:11.722727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1032/2037] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:11.734029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.735565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:11.755008 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1006/2038] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:11.763233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.763875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.764145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.784813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:11.786287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:11.797063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1007/2039] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:11.800220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.808259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15890625-16c4-4e3f-9d54-a8c1e4fa6c24 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:11.810202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:11.810915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.811194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.811304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34308520-15ad-473b-9b4d-d0e777229828 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:11.811603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.823184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:11.823444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:11.824789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:11.824990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.825561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.826014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.826889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:11.827336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:11.829106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:11.835871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1033/2040] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:11.843012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1008/2041] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:11.847281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.858174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6756-a389-4ed3-8ae7-87f664e4d55a service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:11.879763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:11.881419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:11.881850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:11.882770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:11.883139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:11.889333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:11.926728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1034/2042] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:11 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:11.930909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:11.944788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eed4d7-2456-4c71-ab54-050ca92e4d3c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.043013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.045675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.045989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.046235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.047289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.051649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.097600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1009/2043] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:11 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:12.103105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.125409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad774f-3cf9-4a46-b1af-d2fc50ab4a63 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.133628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.134347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.134619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.134896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.135646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.137427 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.151612 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1035/2044] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:12.155679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.169053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e5be-65ad-4ee4-a082-dbe78d17b826 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.175732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.176439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.176721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.177040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.177788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.179415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.190295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1010/2045] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:12.194569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.205338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b15f90-62b6-48fc-bde6-29f492b9ec09 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.214866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3015484-f5a4-4e8d-92f9-3d0c7713bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.216207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3015484-f5a4-4e8d-92f9-3d0c7713bbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.216547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3015484-f5a4-4e8d-92f9-3d0c7713bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.216997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3015484-f5a4-4e8d-92f9-3d0c7713bbd8 admin admin] PATH_INFO: `/v3/projects/691b2dfdf81440348baa555be6ddd1ac/users/34bec6de7e4f435898ecc56c3b8e921c/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.231225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.233117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:12.235851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3015484-f5a4-4e8d-92f9-3d0c7713bbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691b2dfdf81440348baa555be6ddd1ac, user_id=34bec6de7e4f435898ecc56c3b8e921c, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.238881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3015484-f5a4-4e8d-92f9-3d0c7713bbd8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.248681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c24bd5-0442-46e6-bff7-eeda1f5dfb84 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.254287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.255588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.255923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.256207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] PATH_INFO: `/v3/projects/5252180128664b20b9f5a43a731a7863` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.257545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5252180128664b20b9f5a43a731a7863)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.259865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.268964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1036/2046] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:12 2022] PUT /identity/v3/projects/691b2dfdf81440348baa555be6ddd1ac/users/34bec6de7e4f435898ecc56c3b8e921c/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:12.280547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.281310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.281778 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.314301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] MFA Rules not processed for user `34bec6de7e4f435898ecc56c3b8e921c`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:12.315882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:12.331949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5252180128664b20b9f5a43a731a7863', 'request_id': 'req-b454e825-716e-4fba-a9fa-842ab29a3148'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.342967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5252180128664b20b9f5a43a731a7863', 'request_id': 'req-b454e825-716e-4fba-a9fa-842ab29a3148'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.351369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5252180128664b20b9f5a43a731a7863', 'request_id': 'req-b454e825-716e-4fba-a9fa-842ab29a3148'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.364415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] The token cache is being invalidate because project 5252180128664b20b9f5a43a731a7863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:12.366681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.375152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.377302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1011/2047] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:12 2022] DELETE /identity/v3/projects/5252180128664b20b9f5a43a731a7863 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:12.382290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.385728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:12.404395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1037/2048] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:12.409594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.411862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:12.482511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e825-716e-4fba-a9fa-842ab29a3148 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.487831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.488046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495ba9-b84f-456d-81e8-1be321d284c7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.488506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.488774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.489537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] PATH_INFO: `/v3/users/9fbf189e7a254a8d827d045725703c6c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.490780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbf189e7a254a8d827d045725703c6c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.492951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.493487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.494580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.494764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.495011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.495729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.497668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.535030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1038/2049] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:12 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:12.536875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.553168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbf189e7a254a8d827d045725703c6c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.560171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbf189e7a254a8d827d045725703c6c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.573788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbf189e7a254a8d827d045725703c6c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.574507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbf189e7a254a8d827d045725703c6c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.575132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbf189e7a254a8d827d045725703c6c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:12.595624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1012/2050] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:12 2022] DELETE /identity/v3/users/9fbf189e7a254a8d827d045725703c6c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:12.614130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7777b5-035c-4e26-804e-f0fd5e83f3d8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.673874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.674608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.674851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.675106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.675802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.678250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.705046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1039/2051] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:12 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:12.706366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.708108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:12.723635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a2b4d-b1d2-425c-9a06-b76b158c0c54 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.729228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.729910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.730189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.730463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.731544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.732846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.749263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1013/2052] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:12.750735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.767654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7af01-2d7f-4788-9c43-227860e92444 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.776206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.777416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.777586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.777859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] PATH_INFO: `/v3/projects/74724006c3d14afcbb43b6e531695a3f/users/edfc020a57114b75a7f4e9152709c881/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.803193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74724006c3d14afcbb43b6e531695a3f, user_id=edfc020a57114b75a7f4e9152709c881, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.806292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.853209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1040/2053] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:12 2022] PUT /identity/v3/projects/74724006c3d14afcbb43b6e531695a3f/users/edfc020a57114b75a7f4e9152709c881/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:12.865328 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.877032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c618-61bd-4b59-b0de-02350b60458c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:12.968577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:12.969412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:12.969687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:12.969955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:12.970683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:12.972308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:12.976286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:12.978644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:12.990772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1014/2054] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:12.994894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210a5d-92cc-4c06-a1e7-08b038e9b749 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.003249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.004148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.004583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.004863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] PATH_INFO: `/v3/projects/a5a36eb12b234c73815bfb4eed59c9e0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.006479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a36eb12b234c73815bfb4eed59c9e0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.008355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.008480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.027762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a9b37-d924-4b32-b028-e11e5c676dce admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.034270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e4454-08ea-4815-b02f-54d26a4580eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.035628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e4454-08ea-4815-b02f-54d26a4580eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.036018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e4454-08ea-4815-b02f-54d26a4580eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.036350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e4454-08ea-4815-b02f-54d26a4580eb admin admin] PATH_INFO: `/v3/projects/74724006c3d14afcbb43b6e531695a3f/users/edfc020a57114b75a7f4e9152709c881/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.039067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e4454-08ea-4815-b02f-54d26a4580eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=74724006c3d14afcbb43b6e531695a3f, user_id=edfc020a57114b75a7f4e9152709c881, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.043949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e4454-08ea-4815-b02f-54d26a4580eb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.060941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1015/2055] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:13 2022] PUT /identity/v3/projects/74724006c3d14afcbb43b6e531695a3f/users/edfc020a57114b75a7f4e9152709c881/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:13.073427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947df6-0727-4693-9b1b-d4999015631a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.073971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947df6-0727-4693-9b1b-d4999015631a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.074325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947df6-0727-4693-9b1b-d4999015631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.117059 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a36eb12b234c73815bfb4eed59c9e0', 'request_id': 'req-4cc5048f-5533-4bce-8b79-0061ec284f0a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:13.142699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a36eb12b234c73815bfb4eed59c9e0', 'request_id': 'req-4cc5048f-5533-4bce-8b79-0061ec284f0a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:13.151861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a36eb12b234c73815bfb4eed59c9e0', 'request_id': 'req-4cc5048f-5533-4bce-8b79-0061ec284f0a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:13.166114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] The token cache is being invalidate because project a5a36eb12b234c73815bfb4eed59c9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:13.166759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:13.167483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4cc5048f-5533-4bce-8b79-0061ec284f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:13.175254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1041/2056] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:12 2022] DELETE /identity/v3/projects/a5a36eb12b234c73815bfb4eed59c9e0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:13.178395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7d947df6-0727-4693-9b1b-d4999015631a None None] MFA Rules not processed for user `edfc020a57114b75a7f4e9152709c881`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:13.182411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7d947df6-0727-4693-9b1b-d4999015631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:13.183146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.183660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.184193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.223543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:13.225325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:13.292236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1016/2057] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:13.304088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1042/2058] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:13.313146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.313963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.314105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.314556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.320715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:13.350707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:13.352036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:13.367803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1017/2059] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:13.372159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.385725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17da862-d3d1-4063-b5aa-2da64fad6dbd None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.398595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ecce-e9b6-41c2-9006-162c390625ec None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.405963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.406801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.407083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.407406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.407898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.408950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.409491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:13.410823 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.412309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.413553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:13.414050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.415936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.435027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1018/2060] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:11:13.439724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.458089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370c526-b829-421b-bd81-0b89f6d4fbab admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.463755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.464919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.465171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.465451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.466975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.468338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.505305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.507835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.508424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1019/2061] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:13 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:13.512590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.526275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1043/2062] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:13.614249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b6e2-29c7-402e-bdcc-131b754e9a26 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.621335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.622137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.622361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.622640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.623376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.627871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.663023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1020/2063] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:13 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:13.666984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.687706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a12b7-29cb-437f-bca8-633575ebb702 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.695558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.696804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.697245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.697520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.699234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.702387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.725999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1044/2064] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:13.730042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.743535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c879a0b-33f2-422a-a335-4cd7351bb708 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.757847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969775b-4d98-43f4-9961-918ad739c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.759125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969775b-4d98-43f4-9961-918ad739c0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.759536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969775b-4d98-43f4-9961-918ad739c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.759877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969775b-4d98-43f4-9961-918ad739c0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.760689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969775b-4d98-43f4-9961-918ad739c0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.764199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969775b-4d98-43f4-9961-918ad739c0a8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.791542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1021/2065] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:13.794007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:13.815377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9346d-475c-49b1-931d-25f805e07120 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:13.823542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:13.826336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.826336 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.826546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] PATH_INFO: `/v3/projects/594a46e85c404fb6b613ae5222b92d8a/users/738400bad4654dc597b996720ace0661/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.883413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594a46e85c404fb6b613ae5222b92d8a, user_id=738400bad4654dc597b996720ace0661, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:13.887537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:13.923991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1045/2066] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:13 2022] PUT /identity/v3/projects/594a46e85c404fb6b613ae5222b92d8a/users/738400bad4654dc597b996720ace0661/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:13.935547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:13.941545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:13.941966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:13.979867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] MFA Rules not processed for user `738400bad4654dc597b996720ace0661`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:13.982925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:14.086656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1022/2067] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:14.098421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:14.163756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd82b67-8768-4df8-86a1-fcb45a4e1f97 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:14.167967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fca61-9e06-47a8-afb8-10d864ca49dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:14.168734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fca61-9e06-47a8-afb8-10d864ca49dc service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:14.169218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fca61-9e06-47a8-afb8-10d864ca49dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:14.169596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fca61-9e06-47a8-afb8-10d864ca49dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:14.186986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fca61-9e06-47a8-afb8-10d864ca49dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:14.188766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fca61-9e06-47a8-afb8-10d864ca49dc service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:14.202739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1046/2068] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:16.186429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:16.188498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:16.260585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0416fd-c5fb-4f17-9e4f-3f04f64ad09a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:16.266535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:16.267528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:16.267875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:16.268216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] PATH_INFO: `/v3/users/34bec6de7e4f435898ecc56c3b8e921c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:16.269589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bec6de7e4f435898ecc56c3b8e921c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:16.271517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:16.323687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bec6de7e4f435898ecc56c3b8e921c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:16.331195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bec6de7e4f435898ecc56c3b8e921c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:16.342134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bec6de7e4f435898ecc56c3b8e921c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:16.342862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bec6de7e4f435898ecc56c3b8e921c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:16.343622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bec6de7e4f435898ecc56c3b8e921c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:16.364832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1023/2069] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:16 2022] DELETE /identity/v3/users/34bec6de7e4f435898ecc56c3b8e921c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:16.369586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:16.370056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:16.370161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:16.390370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:16.391604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:16.453722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1047/2070] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:16.463898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:16.465445 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:16.525853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007073ac-b4ec-40b7-a06f-5136fc270636 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:16.529883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:16.530551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:16.530830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:16.531086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:16.540661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:16.542233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:16.552356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1024/2071] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:16.973970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:16.975483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:16.988415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cd76d-f8ef-489f-acf1-0ce03a9369a6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:16.994312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:16.995259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:16.995603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:16.995884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] PATH_INFO: `/v3/projects/691b2dfdf81440348baa555be6ddd1ac` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:16.997156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=691b2dfdf81440348baa555be6ddd1ac)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:16.999046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:17.064277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691b2dfdf81440348baa555be6ddd1ac', 'request_id': 'req-161c1675-55bd-4f0a-8320-f35f3a1ab41f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.073025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691b2dfdf81440348baa555be6ddd1ac', 'request_id': 'req-161c1675-55bd-4f0a-8320-f35f3a1ab41f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.078761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691b2dfdf81440348baa555be6ddd1ac', 'request_id': 'req-161c1675-55bd-4f0a-8320-f35f3a1ab41f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.089752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] The token cache is being invalidate because project 691b2dfdf81440348baa555be6ddd1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:17.090039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.090702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.092251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1048/2072] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:16 2022] DELETE /identity/v3/projects/691b2dfdf81440348baa555be6ddd1ac => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:17.096266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:17.106218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5ebe-c3f2-40a0-95ae-ac12acc1827c service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:17.166733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:17.167628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:17.167903 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:17.168189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] PATH_INFO: `/v3/users/edfc020a57114b75a7f4e9152709c881` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:17.169527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfc020a57114b75a7f4e9152709c881)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:17.171517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:17.232679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfc020a57114b75a7f4e9152709c881'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.239491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfc020a57114b75a7f4e9152709c881'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.248656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfc020a57114b75a7f4e9152709c881'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.249373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfc020a57114b75a7f4e9152709c881'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.250223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8a0ebef-aba7-405d-8ad5-286bb82e3a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfc020a57114b75a7f4e9152709c881'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.268455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1025/2073] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:17 2022] DELETE /identity/v3/users/edfc020a57114b75a7f4e9152709c881 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:17.568429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:17.569899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:17.583321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1675-55bd-4f0a-8320-f35f3a1ab41f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:17.640228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:17.641121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:17.641400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:17.641675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] PATH_INFO: `/v3/projects/74724006c3d14afcbb43b6e531695a3f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:17.642876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=74724006c3d14afcbb43b6e531695a3f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:17.644838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:17.692839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74724006c3d14afcbb43b6e531695a3f', 'request_id': 'req-94db63d4-4804-441a-a2ff-899f812dc0df'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.702238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74724006c3d14afcbb43b6e531695a3f', 'request_id': 'req-94db63d4-4804-441a-a2ff-899f812dc0df'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.710628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74724006c3d14afcbb43b6e531695a3f', 'request_id': 'req-94db63d4-4804-441a-a2ff-899f812dc0df'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.726385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] The token cache is being invalidate because project 74724006c3d14afcbb43b6e531695a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:17.726779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.727575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94db63d4-4804-441a-a2ff-899f812dc0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:17.729147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1049/2074] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:17 2022] DELETE /identity/v3/projects/74724006c3d14afcbb43b6e531695a3f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:17.734438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:17.734726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:17.735003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:17.752637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:17.753814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:17.827999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1026/2075] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:17.837521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:17.837811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:17.838088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:17.857586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:17.858795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:17.867164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1050/2076] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:17.872680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:17.886594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a4a9-3dfd-4f43-921c-8da409a66e2d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:17.892667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:17.893357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:17.893637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:17.893905 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:17.894660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:17.894961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:17.896672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:17.910442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1027/2077] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:17.916971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:17.932563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451450f2-9581-4971-b3d2-b40079a16b8e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:17.940931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:17.941753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:17.942077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:17.942403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:17.943433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:17.946279 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:17.975927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1051/2078] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:17 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:17.980747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:17.991093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141432b8-764e-4651-b4d4-bbc3bee24f08 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.056479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.057215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.057500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.057775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.058507 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.060442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.081998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1028/2079] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:17 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:18.086391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.097814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f432-2824-4747-83fb-78d786a7261b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.103685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.104363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.104708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.105026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.105763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.107356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.118862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1052/2080] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:18.123064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.132999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d1ad-5ab0-44b5-9512-1f39c8422911 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.138053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40bfed-df5b-49ea-86ca-af8174a2e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.139078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40bfed-df5b-49ea-86ca-af8174a2e260 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.139353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40bfed-df5b-49ea-86ca-af8174a2e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.140245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40bfed-df5b-49ea-86ca-af8174a2e260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.140357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40bfed-df5b-49ea-86ca-af8174a2e260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.142054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40bfed-df5b-49ea-86ca-af8174a2e260 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.152259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1029/2081] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:18.157061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.168712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840819-c093-4a26-9ff5-bc68816b0b52 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.174509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.175548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.175870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.176147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] PATH_INFO: `/v3/projects/4c36aab88b794631ba64f186f2edf06e/users/a67671ae06d147209d088c94060f91ff/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.191789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c36aab88b794631ba64f186f2edf06e, user_id=a67671ae06d147209d088c94060f91ff, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.194465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.209909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1053/2082] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:18 2022] PUT /identity/v3/projects/4c36aab88b794631ba64f186f2edf06e/users/a67671ae06d147209d088c94060f91ff/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:18.220509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.220832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.221144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.247788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] MFA Rules not processed for user `a67671ae06d147209d088c94060f91ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:18.249049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:18.324283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1030/2083] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:18.328913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.395780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f3885-0a16-43d5-8200-57d08b4c32c4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.402086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.402779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.403060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.403335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.404031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.405980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.436796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1054/2084] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:18 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:18.437928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.449142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3682701-2693-4ba9-9768-b87c3209ab14 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.507399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.508235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.508515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.509018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.509724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.511662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.533679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1031/2085] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:18 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:18.537870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.548883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ae54-5d4f-4a9d-9c57-daa6ca69cd3c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.553966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.554656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.554945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.555240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.555997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.557651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.568022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1055/2086] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:18.572290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.583377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51348-274e-4a4a-95d8-6842c9c00b13 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.589474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf014dc-41b7-41e0-a6f5-52ce1de4b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.590127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf014dc-41b7-41e0-a6f5-52ce1de4b59c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.590407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf014dc-41b7-41e0-a6f5-52ce1de4b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.590679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf014dc-41b7-41e0-a6f5-52ce1de4b59c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.591412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf014dc-41b7-41e0-a6f5-52ce1de4b59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.593039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf014dc-41b7-41e0-a6f5-52ce1de4b59c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.604093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1032/2087] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:18.608340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.619572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5610-a317-4234-ba0a-3c376c2e90a0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.625490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.626384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.626664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.626939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] PATH_INFO: `/v3/projects/85ebc0e5e2234b93b894dc8f8c246998/users/59c385fa31844dd79b90b8afab95b075/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.643401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ebc0e5e2234b93b894dc8f8c246998, user_id=59c385fa31844dd79b90b8afab95b075, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.646105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.663646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1056/2088] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:18 2022] PUT /identity/v3/projects/85ebc0e5e2234b93b894dc8f8c246998/users/59c385fa31844dd79b90b8afab95b075/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:18.679476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.679768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.680110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.713163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] MFA Rules not processed for user `59c385fa31844dd79b90b8afab95b075`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:18.714421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:18.783764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1033/2089] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:18.788475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.863843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13e8c-ab55-4874-8a0b-f8d532cdac14 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.870622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.871319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.871605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.871879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.872585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.874571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:18.904691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1057/2090] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:18 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:18.908734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:18.920045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482cd56-8cec-49a0-a460-e888141ccc42 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:18.980756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:18.981469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:18.981746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:18.982019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:18.982711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:18.984610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:19.006672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1034/2091] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:18 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:19.012575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:19.027531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92267ac-8f22-4b07-bc60-e8ba6b25f41a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:19.032556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:19.033256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:19.033537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:19.033795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:19.034523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:19.036151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:19.047789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1058/2092] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:19.051919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:19.062875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a72787-0457-468c-b532-150a2c6dccdf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:19.074871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:19.075768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:19.076032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:19.076305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] PATH_INFO: `/v3/projects/177ffc1035ef49478be12082fd7cf288/users/4f348cf5866641048c616212342846cf/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:19.092801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177ffc1035ef49478be12082fd7cf288, user_id=4f348cf5866641048c616212342846cf, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:19.095452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:19.111094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1035/2093] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:19 2022] PUT /identity/v3/projects/177ffc1035ef49478be12082fd7cf288/users/4f348cf5866641048c616212342846cf/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:19.115112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:19.125247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d426-c1ed-4cd1-ae3c-b83aee5010d1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:19.186269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3206-8703-469a-95c0-affca69735ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:19.186944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3206-8703-469a-95c0-affca69735ea admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:19.187225 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3206-8703-469a-95c0-affca69735ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:19.187498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3206-8703-469a-95c0-affca69735ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:19.188232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3206-8703-469a-95c0-affca69735ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:19.189892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3206-8703-469a-95c0-affca69735ea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:19.203791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1059/2094] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:19.208083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:19.219708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2269fd-89ae-4338-9318-40294d8d1616 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:19.225736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:19.226759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:19.227219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:19.227567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] PATH_INFO: `/v3/projects/177ffc1035ef49478be12082fd7cf288/users/4f348cf5866641048c616212342846cf/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:19.229796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177ffc1035ef49478be12082fd7cf288, user_id=4f348cf5866641048c616212342846cf, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:19.232436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:19.245144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1036/2095] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:19 2022] PUT /identity/v3/projects/177ffc1035ef49478be12082fd7cf288/users/4f348cf5866641048c616212342846cf/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:19.257309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:19.257682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:19.258219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:19.292186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] MFA Rules not processed for user `4f348cf5866641048c616212342846cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:19.294366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:19.376574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1060/2096] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:19.388652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:19.390661 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:19.459049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e7834-2e93-4f67-b044-b0f7a1f39a64 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:19.463004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:19.463659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:19.463936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:19.464214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:19.529558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:19.542331 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:19.558922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1037/2097] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:24.229325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:24.239200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68439a-37bb-4d04-8a67-5b1fc7361073 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:24.243037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:24.243674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:24.243946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:24.244213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:24.305972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:24.307931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:24.317600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1061/2098] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:24.947280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:24.956611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3be149-3637-403d-8142-ed9f3b07762e service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:24.961424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf736c-b42c-4f76-9046-d3961c9927a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:24.962082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf736c-b42c-4f76-9046-d3961c9927a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:24.962392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf736c-b42c-4f76-9046-d3961c9927a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:24.962666 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf736c-b42c-4f76-9046-d3961c9927a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:24.972709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf736c-b42c-4f76-9046-d3961c9927a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:24.974205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf736c-b42c-4f76-9046-d3961c9927a2 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:24.983727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1038/2099] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:25.908486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:25.910161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:25.978893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0196cf-d622-49ec-a571-aeedcfc79ab0 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:25.984917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:25.984917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:25.985190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:25.986712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] PATH_INFO: `/v3/users/738400bad4654dc597b996720ace0661` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:25.987464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=738400bad4654dc597b996720ace0661)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:25.989624 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:26.056915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738400bad4654dc597b996720ace0661'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.066163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738400bad4654dc597b996720ace0661'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.079947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738400bad4654dc597b996720ace0661'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.087901 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738400bad4654dc597b996720ace0661'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.088578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738400bad4654dc597b996720ace0661'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.101577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1062/2100] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:25 2022] DELETE /identity/v3/users/738400bad4654dc597b996720ace0661 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:26.106039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.106493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.106595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.151993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:26.153270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:26.227257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1039/2101] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:26.237450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:26.239007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:26.305689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d574fc-0f60-4d90-b8e9-75b7c77e5d4a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:26.309827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590240b-29b6-4469-96c7-df2c41214c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:26.310885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590240b-29b6-4469-96c7-df2c41214c73 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.311164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590240b-29b6-4469-96c7-df2c41214c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.311435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590240b-29b6-4469-96c7-df2c41214c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.322853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590240b-29b6-4469-96c7-df2c41214c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:26.324289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590240b-29b6-4469-96c7-df2c41214c73 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:26.336937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1063/2102] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:26.650254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:26.651705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:26.667028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c050e7f-6850-4235-97a9-945d252b72c2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:26.672503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:26.673501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.673784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.674045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] PATH_INFO: `/v3/projects/594a46e85c404fb6b613ae5222b92d8a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.676042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=594a46e85c404fb6b613ae5222b92d8a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:26.678421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:26.727806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594a46e85c404fb6b613ae5222b92d8a', 'request_id': 'req-f343b699-e622-4b1c-97c4-a50dcb7cb25a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.735483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594a46e85c404fb6b613ae5222b92d8a', 'request_id': 'req-f343b699-e622-4b1c-97c4-a50dcb7cb25a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.742149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594a46e85c404fb6b613ae5222b92d8a', 'request_id': 'req-f343b699-e622-4b1c-97c4-a50dcb7cb25a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.752630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] The token cache is being invalidate because project 594a46e85c404fb6b613ae5222b92d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:26.752934 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.753608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f343b699-e622-4b1c-97c4-a50dcb7cb25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:26.755242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1040/2103] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:26 2022] DELETE /identity/v3/projects/594a46e85c404fb6b613ae5222b92d8a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:26.761953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.762229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.762516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.782255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:26.783461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:26.845824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1064/2104] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:26.853541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.853850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.854127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.873051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:26.874245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:26.882567 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1041/2105] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:26.887026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:26.897054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f898-678d-4ff2-928e-f1bdeca3ef06 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:26.903550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:26.904775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.905087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.905542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.906499 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:26.906844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:26.909466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:26.921899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1065/2106] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:11:26.926366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:26.936288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bccbac-a0fe-4d95-aeb5-4a29f14bffbc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:26.942381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:26.943172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:26.943449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:26.943710 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:26.944461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:26.946435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:26.974879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1042/2107] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:26 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:26.979232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:26.989508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11856daf-564c-4937-accf-9c41de4c95b6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:27.046355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:27.047034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:27.047334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:27.047602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:27.048332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:27.050222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:27.072665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1066/2108] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:26 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:27.076691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:27.087438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeeb79-7b4e-4d31-b9be-22c02d295f52 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:27.092985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:27.093691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:27.094106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:27.094388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:27.095152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:27.096742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:27.108301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1043/2109] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:27.112298 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:27.122996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa9c9-6c42-4cda-89c7-a8f79b680401 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:27.127974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338cdb3-8c88-4405-8316-cfa230f5a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:27.128644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338cdb3-8c88-4405-8316-cfa230f5a093 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:27.128937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338cdb3-8c88-4405-8316-cfa230f5a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:27.129220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338cdb3-8c88-4405-8316-cfa230f5a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:27.129958 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338cdb3-8c88-4405-8316-cfa230f5a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:27.131558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338cdb3-8c88-4405-8316-cfa230f5a093 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:27.142653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1067/2110] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:27.146615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:27.158199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9c8a-af84-442c-8b8a-fde86ed4be44 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:27.163885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:27.164889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:27.165201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:27.165476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] PATH_INFO: `/v3/projects/19f2fb7fe23a462ba083d732587b863c/users/788b32ff71fd41d18f9e061f0d665444/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:27.183017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f2fb7fe23a462ba083d732587b863c, user_id=788b32ff71fd41d18f9e061f0d665444, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:27.185813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:27.200225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1044/2111] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:27 2022] PUT /identity/v3/projects/19f2fb7fe23a462ba083d732587b863c/users/788b32ff71fd41d18f9e061f0d665444/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:27.210695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:27.210987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:27.211261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:27.240229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] MFA Rules not processed for user `788b32ff71fd41d18f9e061f0d665444`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:27.241546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:27.307506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1068/2112] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:27.319931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:27.323014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:27.386325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96e1f6-fd6f-45a1-a46f-26f976fbccf8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:27.390631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bae04-ff63-42bb-bdd7-91929296ace6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:27.391280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bae04-ff63-42bb-bdd7-91929296ace6 service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:27.391555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bae04-ff63-42bb-bdd7-91929296ace6 service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:27.391826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bae04-ff63-42bb-bdd7-91929296ace6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:27.400697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bae04-ff63-42bb-bdd7-91929296ace6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:27.402156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bae04-ff63-42bb-bdd7-91929296ace6 service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:27.413095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1045/2113] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:28.967827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:28.969362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:29.062639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027a706-8931-4466-88ec-83d264aa19cb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:29.067541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:29.068832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:29.069303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:29.069724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] PATH_INFO: `/v3/users/a67671ae06d147209d088c94060f91ff` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:29.071316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67671ae06d147209d088c94060f91ff)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:29.074346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:29.128284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67671ae06d147209d088c94060f91ff'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.135151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67671ae06d147209d088c94060f91ff'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.147179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67671ae06d147209d088c94060f91ff'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.154871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67671ae06d147209d088c94060f91ff'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.155515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67671ae06d147209d088c94060f91ff'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.161531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1069/2114] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:28 2022] DELETE /identity/v3/users/a67671ae06d147209d088c94060f91ff => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:29.166369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:29.166864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:29.167047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:29.184458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:29.185694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:29.252956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1046/2115] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:29.263356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:29.264943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:29.330487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b651-c248-42b4-85e2-5505635ff61b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:29.334616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:29.335271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:29.335685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:29.335960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:29.346044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:29.347491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:29.357249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1070/2116] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:29.674253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:29.675686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:29.687982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eac411-0883-4a3c-bf36-11705dde5450 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:29.697742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:29.698697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:29.698913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:29.699184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] PATH_INFO: `/v3/projects/4c36aab88b794631ba64f186f2edf06e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:29.700475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c36aab88b794631ba64f186f2edf06e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:29.702646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:29.753465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c36aab88b794631ba64f186f2edf06e', 'request_id': 'req-7b8acb25-692a-4bb9-978c-dddffce27510'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.762689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c36aab88b794631ba64f186f2edf06e', 'request_id': 'req-7b8acb25-692a-4bb9-978c-dddffce27510'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.772965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c36aab88b794631ba64f186f2edf06e', 'request_id': 'req-7b8acb25-692a-4bb9-978c-dddffce27510'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.785904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] The token cache is being invalidate because project 4c36aab88b794631ba64f186f2edf06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:29.786200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.787177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.788975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1047/2117] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:29 2022] DELETE /identity/v3/projects/4c36aab88b794631ba64f186f2edf06e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:29.793194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:29.804306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4fe10-fef4-405e-b060-aabaa6a2273e service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:29.882121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:29.883014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:29.883289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:29.883557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] PATH_INFO: `/v3/users/59c385fa31844dd79b90b8afab95b075` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:29.884744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c385fa31844dd79b90b8afab95b075)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:29.887042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:29.941488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c385fa31844dd79b90b8afab95b075'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.948233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c385fa31844dd79b90b8afab95b075'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.960774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c385fa31844dd79b90b8afab95b075'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.969731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c385fa31844dd79b90b8afab95b075'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.970729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c385fa31844dd79b90b8afab95b075'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:29.976697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1071/2118] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:29 2022] DELETE /identity/v3/users/59c385fa31844dd79b90b8afab95b075 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:30.217266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.219866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.238204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8acb25-692a-4bb9-978c-dddffce27510 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:30.297983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:30.298873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.299290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.299471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] PATH_INFO: `/v3/users/5a033fa406b14ff19343065c5a459dd7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.300630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a033fa406b14ff19343065c5a459dd7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:30.302664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:30.327784 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.329928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.346810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6041-df4c-4ce1-84b2-f82d6dcba1a0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:30.351576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:30.353226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.353509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.353776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] PATH_INFO: `/v3/projects/85ebc0e5e2234b93b894dc8f8c246998` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.355084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a033fa406b14ff19343065c5a459dd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.355232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ebc0e5e2234b93b894dc8f8c246998)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:30.357728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:30.365372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a033fa406b14ff19343065c5a459dd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.374298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a033fa406b14ff19343065c5a459dd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.376372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a033fa406b14ff19343065c5a459dd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.377042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a033fa406b14ff19343065c5a459dd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.400122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1048/2119] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:30 2022] DELETE /identity/v3/users/5a033fa406b14ff19343065c5a459dd7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:30.415636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ebc0e5e2234b93b894dc8f8c246998', 'request_id': 'req-2f9460ed-a94a-4b2e-962e-6de59aa9debe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.423663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ebc0e5e2234b93b894dc8f8c246998', 'request_id': 'req-2f9460ed-a94a-4b2e-962e-6de59aa9debe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.429309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ebc0e5e2234b93b894dc8f8c246998', 'request_id': 'req-2f9460ed-a94a-4b2e-962e-6de59aa9debe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.440892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] The token cache is being invalidate because project 85ebc0e5e2234b93b894dc8f8c246998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:30.441281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.441991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.443547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1072/2120] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:30 2022] DELETE /identity/v3/projects/85ebc0e5e2234b93b894dc8f8c246998 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:30.448072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.449161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.514449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96617-8889-4274-b04c-d97baf447e9e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:30.579706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:30.580862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.581301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.581627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] PATH_INFO: `/v3/users/4f348cf5866641048c616212342846cf` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.582180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.583471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f348cf5866641048c616212342846cf)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:30.585790 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.586321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:30.611755 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9460ed-a94a-4b2e-962e-6de59aa9debe admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:30.616787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:30.617772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.618134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.618451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] PATH_INFO: `/v3/projects/4c3cf8bdbf3b456480c868d1ffd0a75f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.619790 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3cf8bdbf3b456480c868d1ffd0a75f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:30.621886 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:30.641015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f348cf5866641048c616212342846cf'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.648691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f348cf5866641048c616212342846cf'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.657031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f348cf5866641048c616212342846cf'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.657825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f348cf5866641048c616212342846cf'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.658592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-635a9f81-36b6-47a4-a767-ba3e40026b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f348cf5866641048c616212342846cf'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.672330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3cf8bdbf3b456480c868d1ffd0a75f', 'request_id': 'req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.678684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1049/2121] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:30 2022] DELETE /identity/v3/users/4f348cf5866641048c616212342846cf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:30.681058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3cf8bdbf3b456480c868d1ffd0a75f', 'request_id': 'req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.686440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3cf8bdbf3b456480c868d1ffd0a75f', 'request_id': 'req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.698096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] The token cache is being invalidate because project 4c3cf8bdbf3b456480c868d1ffd0a75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:30.698401 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.699052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-24c10d2e-5548-4e3b-8466-7c1ef7e430ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:30.700650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1073/2122] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:30 2022] DELETE /identity/v3/projects/4c3cf8bdbf3b456480c868d1ffd0a75f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:30.705886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.706403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.706857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.726599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:30.728159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.823475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1050/2123] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:30.826214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.826579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.827152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.855277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:30.856502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.876094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1074/2124] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:30.880474 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.890745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d39190-e738-48ca-8d92-0d17074d1b00 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:30.896147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:30.896859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.897145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.897419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.898247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:30.898428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:30.900050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:30.916230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1051/2125] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:11:30.917576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.927632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ce4cd-c4cc-4218-b444-6cf85024cdc2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:30.932929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:30.934769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:30.935249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:30.936287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:30.936927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:30.939262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:30.969943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1075/2126] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:30.974326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.978564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:30.980594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:30.988390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45523169-e141-4df9-bffb-487b59d18dff admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.052390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f472008-22d7-49db-8d53-ad07ac341cae admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.057433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.057608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.058187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.058358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.058471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.058621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.058713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.058899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] PATH_INFO: `/v3/projects/177ffc1035ef49478be12082fd7cf288` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.060137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.060254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=177ffc1035ef49478be12082fd7cf288)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.062991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.063368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.100608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1052/2127] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:30 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:31.104976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.119351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d43399-953b-4bb0-9b99-05f9db9cec42 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.134109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177ffc1035ef49478be12082fd7cf288', 'request_id': 'req-731921b5-e82a-493b-9c59-c4f6d55ca8bd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:31.145227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177ffc1035ef49478be12082fd7cf288', 'request_id': 'req-731921b5-e82a-493b-9c59-c4f6d55ca8bd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:31.151343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177ffc1035ef49478be12082fd7cf288', 'request_id': 'req-731921b5-e82a-493b-9c59-c4f6d55ca8bd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:31.164658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] The token cache is being invalidate because project 177ffc1035ef49478be12082fd7cf288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:31.164962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:31.166123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-731921b5-e82a-493b-9c59-c4f6d55ca8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:31.167918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1076/2128] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:30 2022] DELETE /identity/v3/projects/177ffc1035ef49478be12082fd7cf288 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:11:31.174287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45899-ef3d-4dfe-9d91-1532860641c8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.174944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45899-ef3d-4dfe-9d91-1532860641c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.174944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45899-ef3d-4dfe-9d91-1532860641c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.194548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-56c45899-ef3d-4dfe-9d91-1532860641c8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:31.195801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-56c45899-ef3d-4dfe-9d91-1532860641c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.206392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.207074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.207357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.207634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.208699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.210129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.229124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1053/2129] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:31.231880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.234462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.247822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad73ab-2526-47ea-9a7e-881fc5e239d9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.252985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.253652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.253929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.254201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.254924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.256534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.265164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1077/2130] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:31.268252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1054/2131] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:31.273147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.273566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.273862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.274146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.283655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18cbf0-bdde-4ef7-b5fb-5a0d0ecc08a9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.288968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec62c38-a34f-4791-89a4-653851c76e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.290203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec62c38-a34f-4791-89a4-653851c76e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.290482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec62c38-a34f-4791-89a4-653851c76e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.290757 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec62c38-a34f-4791-89a4-653851c76e97 admin admin] PATH_INFO: `/v3/projects/a97a33a2aa5b45e28ce2fbc14234447a/users/cea36666ab2947d8bf2a6abbc197be7f/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.293699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:31.294916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.303328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1078/2132] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:31.307441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.307812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec62c38-a34f-4791-89a4-653851c76e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97a33a2aa5b45e28ce2fbc14234447a, user_id=cea36666ab2947d8bf2a6abbc197be7f, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.310698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec62c38-a34f-4791-89a4-653851c76e97 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.316937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2209b-4059-416f-8f3b-dab182a15688 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.323347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.324424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.324925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.325381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.325529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1055/2133] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:31 2022] PUT /identity/v3/projects/a97a33a2aa5b45e28ce2fbc14234447a/users/cea36666ab2947d8bf2a6abbc197be7f/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:31.326433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:31.326741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.328406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.331255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.331709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.331986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.341297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1079/2134] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:11:31.345822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.351622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:31.353019 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.356092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8e003-6f7f-421f-b3c5-2b8e4a6297e2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.413563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.414634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.414634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.414810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.415464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.417387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.420126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1056/2135] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:31.430122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.431800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.450710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1080/2136] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:31 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:31.451669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.488285 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213aa86-26ed-4feb-b19f-6bf9c213c6e8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.511507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed1f0-3ced-4c74-90e5-c7dbd9fa306f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.520812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.521555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.521957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.522275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.522988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.525736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.541571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.542203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.542613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.542912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.551625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1081/2137] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:31 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:31.552875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.553032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.554375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.562782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6951fa-234e-480b-b433-ce31c48052c8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.564294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1057/2138] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:11:31.568590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.569277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.569556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.569832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.570658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.572189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.586135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1082/2139] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:31.587675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.597840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f04984-cd88-471d-9c30-dfd7c6396e19 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.602495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47b207-49ac-42ba-a4e8-018febcef13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.603158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b207-49ac-42ba-a4e8-018febcef13a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.603440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b207-49ac-42ba-a4e8-018febcef13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.603718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47b207-49ac-42ba-a4e8-018febcef13a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.604449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47b207-49ac-42ba-a4e8-018febcef13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.606086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47b207-49ac-42ba-a4e8-018febcef13a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.616294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1058/2140] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:31.620400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.630769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d600ef6-d965-4105-a3a2-d17de10ea3ea admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.635927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.637028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.637404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.637679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] PATH_INFO: `/v3/projects/cc83aab360054a7f959ceeb6c566de89/users/5e0d7a6c850f4fef88d123fec8665d33/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.654050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc83aab360054a7f959ceeb6c566de89, user_id=5e0d7a6c850f4fef88d123fec8665d33, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.657052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.672038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1083/2141] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:31 2022] PUT /identity/v3/projects/cc83aab360054a7f959ceeb6c566de89/users/5e0d7a6c850f4fef88d123fec8665d33/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:31.678872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c4820-9c89-4037-b2ca-cb88307830bd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.679164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c4820-9c89-4037-b2ca-cb88307830bd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.679438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c4820-9c89-4037-b2ca-cb88307830bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.701377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-da3c4820-9c89-4037-b2ca-cb88307830bd None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:31.703780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-da3c4820-9c89-4037-b2ca-cb88307830bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.767520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1059/2142] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:31.777387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:31.779387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:31.838711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030436bc-f6a7-4c6b-9509-29f74c92f2f9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:31.843704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:31.844324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:31.844752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:31.845164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:31.871027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:31.872538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:31.889406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1084/2143] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:33.059984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c22d8-5fce-4cf5-b094-5b6e2d98406f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:33.060534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c22d8-5fce-4cf5-b094-5b6e2d98406f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:33.060534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c22d8-5fce-4cf5-b094-5b6e2d98406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:33.190952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2e1c22d8-5fce-4cf5-b094-5b6e2d98406f None None] MFA Rules not processed for user `5e0d7a6c850f4fef88d123fec8665d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:33.192287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2e1c22d8-5fce-4cf5-b094-5b6e2d98406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:33.410772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1060/2144] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:33.421272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:33.425259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:33.534546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5784e5-bb4f-4a08-b257-e28285d7b306 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:33.538617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7e567-a510-48d0-b756-c73a21b72517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:33.539516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e567-a510-48d0-b756-c73a21b72517 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:33.540128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e567-a510-48d0-b756-c73a21b72517 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:33.540590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e567-a510-48d0-b756-c73a21b72517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:33.550574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7e567-a510-48d0-b756-c73a21b72517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:33.552178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7e567-a510-48d0-b756-c73a21b72517 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:33.562846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1085/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:36.048843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:36.049345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:36.049420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:36.082936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] MFA Rules not processed for user `5e0d7a6c850f4fef88d123fec8665d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:36.084225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:36.093916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1061/2146] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:36.609795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:36.610859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:36.611265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:36.642257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] MFA Rules not processed for user `cea36666ab2947d8bf2a6abbc197be7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:36.643702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:36.750652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1086/2147] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:36.771505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:36.773510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:36.892232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de074f64-586e-4b80-8f1b-2ece2ab84072 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:36.903278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27db39-f3e8-485d-81b6-e01e430f00e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:36.903278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27db39-f3e8-485d-81b6-e01e430f00e2 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:36.903278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27db39-f3e8-485d-81b6-e01e430f00e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:36.903278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27db39-f3e8-485d-81b6-e01e430f00e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:36.912965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27db39-f3e8-485d-81b6-e01e430f00e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:36.914867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27db39-f3e8-485d-81b6-e01e430f00e2 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:36.927483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1062/2148] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:38.098843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:38.100334 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:38.118718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3f674-11de-4c7e-a1eb-26da91de15d2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:38.126945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:38.128153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:38.128596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:38.128880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] PATH_INFO: `/v3/users/f847040c052844aeaa0454364509d929` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:38.130139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f847040c052844aeaa0454364509d929)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:38.132095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:38.195291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f847040c052844aeaa0454364509d929'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:38.211404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f847040c052844aeaa0454364509d929'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:38.227655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f847040c052844aeaa0454364509d929'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:38.237616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f847040c052844aeaa0454364509d929'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:38.238503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f847040c052844aeaa0454364509d929'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:38.248243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1087/2149] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:38 2022] DELETE /identity/v3/users/f847040c052844aeaa0454364509d929 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:38.253204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0318ce-4879-4350-ba63-acfcd910b16e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:38.253716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0318ce-4879-4350-ba63-acfcd910b16e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:38.253807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0318ce-4879-4350-ba63-acfcd910b16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:38.271486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2f0318ce-4879-4350-ba63-acfcd910b16e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:38.272701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f0318ce-4879-4350-ba63-acfcd910b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:38.338817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1063/2150] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:38.350986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:38.352931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:38.438147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750b9-7cf9-4a95-b5ad-f67eabfe974e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:38.441903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86da45d-b753-4428-90ba-dc4565f3b30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:38.442702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da45d-b753-4428-90ba-dc4565f3b30b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:38.442989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da45d-b753-4428-90ba-dc4565f3b30b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:38.443262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da45d-b753-4428-90ba-dc4565f3b30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:38.452845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86da45d-b753-4428-90ba-dc4565f3b30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:38.454507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86da45d-b753-4428-90ba-dc4565f3b30b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:38.465433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1088/2151] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:38.746282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:38.746813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:38.747264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:38.767689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] MFA Rules not processed for user `353445975d5e444bb3ce55f9d761d4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:38.769151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:38.860779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1064/2152] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:38.959114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23fd52-176a-4f02-9fce-469515f82a75 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:38.959408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23fd52-176a-4f02-9fce-469515f82a75 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:38.959687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23fd52-176a-4f02-9fce-469515f82a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:38.989882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ec23fd52-176a-4f02-9fce-469515f82a75 None None] MFA Rules not processed for user `cea36666ab2947d8bf2a6abbc197be7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:38.991237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ec23fd52-176a-4f02-9fce-469515f82a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:39.075630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1089/2153] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:39.545840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:39.547831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:39.583925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d893-ad8b-4343-bc5e-f3c1c6ff2013 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:39.598998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:39.599845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:39.600128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:39.600405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] PATH_INFO: `/v3/projects/a047490cf14e4ecf8285f0e3a9b551bb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:39.602319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a047490cf14e4ecf8285f0e3a9b551bb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:39.604464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:39.666399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a047490cf14e4ecf8285f0e3a9b551bb', 'request_id': 'req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:39.679138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a047490cf14e4ecf8285f0e3a9b551bb', 'request_id': 'req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:39.687587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a047490cf14e4ecf8285f0e3a9b551bb', 'request_id': 'req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:39.715519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] The token cache is being invalidate because project a047490cf14e4ecf8285f0e3a9b551bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:39.716107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:39.716995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d01c6b8c-8c8d-41ec-8c0d-ed27fa72c483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:39.719045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1065/2154] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:39 2022] DELETE /identity/v3/projects/a047490cf14e4ecf8285f0e3a9b551bb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:39.723994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:39.725043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:39.725467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:39.746994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:39.748234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:39.880109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1090/2155] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:39.890197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:39.890767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:39.891585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:39.932277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:39.934309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:39.947435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1066/2156] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:39.950714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:39.981409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2e4c0-d99a-487d-9844-4ad40c19795e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:39.987235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:39.987921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:39.988202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:39.988475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:39.989275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:39.989725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:39.991400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:40.006734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1091/2157] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:40.010711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:40.024536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed34a-a798-4936-96e3-e10acb3cc7d2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:40.034924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:40.035604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.035885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.036161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.036879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:40.038810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:40.086709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1067/2158] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:40 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:40.090718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:40.102229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a2377-ac11-4160-95ec-caecf61277fb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:40.205717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:40.206395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.206683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.206990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.207657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:40.210054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:40.246001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1092/2159] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:40 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:40.247270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:40.261802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562de537-3607-44e1-9890-4c56e541e8a0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:40.270128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:40.271330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.271755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.272226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.273141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:40.275765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:40.297376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1068/2160] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:40.298678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:40.309916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961b90-7152-4e3f-b2bf-4ff0ae1b5458 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:40.315667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cc37c-cee2-45c2-9d04-5bd573a9a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:40.316487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc37c-cee2-45c2-9d04-5bd573a9a7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.316924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc37c-cee2-45c2-9d04-5bd573a9a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.317413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc37c-cee2-45c2-9d04-5bd573a9a7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.318146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc37c-cee2-45c2-9d04-5bd573a9a7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:40.319978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc37c-cee2-45c2-9d04-5bd573a9a7ac admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:40.335480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1093/2161] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:40.336683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:40.348743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125e5cc-ec33-453a-9c02-cc0f1de960e0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:40.354503 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:40.355401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.355847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.356403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] PATH_INFO: `/v3/projects/696d3e0add7e425cbc9bc89e9cbebade/users/32d776bd6d8746a8b8a70232f769fde2/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.375152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=696d3e0add7e425cbc9bc89e9cbebade, user_id=32d776bd6d8746a8b8a70232f769fde2, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:40.378129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:40.433228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1069/2162] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:40 2022] PUT /identity/v3/projects/696d3e0add7e425cbc9bc89e9cbebade/users/32d776bd6d8746a8b8a70232f769fde2/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:40.444166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.444631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.445164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.504433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] MFA Rules not processed for user `32d776bd6d8746a8b8a70232f769fde2`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:40.506598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:40.674975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1094/2163] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:40.685636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:40.689032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:40.913257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56389558-e8c8-48bf-9c2d-b66bfb2de9dc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:40.942888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eba8f2-22c0-4cb4-9521-326e95079a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:40.946953 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba8f2-22c0-4cb4-9521-326e95079a52 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:40.948253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba8f2-22c0-4cb4-9521-326e95079a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:40.949477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba8f2-22c0-4cb4-9521-326e95079a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:40.973948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eba8f2-22c0-4cb4-9521-326e95079a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:40.976738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eba8f2-22c0-4cb4-9521-326e95079a52 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:41.005323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1070/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:45.344502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:45.409721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc0d91-3b96-41ff-8cce-f58c8d18dc8e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:45.414496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:45.415377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:45.415654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:45.415919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] PATH_INFO: `/v3/users/32d776bd6d8746a8b8a70232f769fde2` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:45.417278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d776bd6d8746a8b8a70232f769fde2)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:45.419309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:45.466730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d776bd6d8746a8b8a70232f769fde2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:45.474210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d776bd6d8746a8b8a70232f769fde2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:45.486579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d776bd6d8746a8b8a70232f769fde2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:45.497389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d776bd6d8746a8b8a70232f769fde2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:45.498129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d776bd6d8746a8b8a70232f769fde2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:45.505714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1095/2165] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:11:45 2022] DELETE /identity/v3/users/32d776bd6d8746a8b8a70232f769fde2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:45.510106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:45.510614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:45.510707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:45.529277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:45.530676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:45.601768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1071/2166] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:45.614806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:45.617867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:45.683558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45772b-d732-4449-86a8-aad31da84122 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:45.687921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11965f-da4a-418c-bf0a-d844b288edb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:45.688577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11965f-da4a-418c-bf0a-d844b288edb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:45.688858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11965f-da4a-418c-bf0a-d844b288edb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:45.689170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11965f-da4a-418c-bf0a-d844b288edb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:45.698960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11965f-da4a-418c-bf0a-d844b288edb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:45.700412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11965f-da4a-418c-bf0a-d844b288edb6 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:45.712951 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1096/2167] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:11:46.090093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.092432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:46.112014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26fcb9-b173-40a8-80eb-9b4191a3fca3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.120656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.122255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.122689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.123130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] PATH_INFO: `/v3/projects/696d3e0add7e425cbc9bc89e9cbebade` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.125031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=696d3e0add7e425cbc9bc89e9cbebade)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.127510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.239488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696d3e0add7e425cbc9bc89e9cbebade', 'request_id': 'req-7d75cb43-b9ee-4437-acc3-af71093631ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:46.259175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696d3e0add7e425cbc9bc89e9cbebade', 'request_id': 'req-7d75cb43-b9ee-4437-acc3-af71093631ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:46.277264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696d3e0add7e425cbc9bc89e9cbebade', 'request_id': 'req-7d75cb43-b9ee-4437-acc3-af71093631ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:46.290678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] The token cache is being invalidate because project 696d3e0add7e425cbc9bc89e9cbebade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:11:46.290973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:46.291793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7d75cb43-b9ee-4437-acc3-af71093631ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:11:46.301251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1072/2168] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:11:46 2022] DELETE /identity/v3/projects/696d3e0add7e425cbc9bc89e9cbebade => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:46.301829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.302181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.302543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.329021 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:46.330279 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:46.404162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1097/2169] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:46.406223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.406511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.406949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.426949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:46.428202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:46.436390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1073/2170] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:11:46.441615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.451839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4790-7de1-40cf-98f9-fe399c474b68 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.457634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.458316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.458577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.458872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.459607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:11:46.459909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.461546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.477211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1098/2171] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:11:46.478635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.489053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bb94c-1774-453a-a4fe-26511da70528 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.494680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.495361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.495641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.495912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.496611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.498560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.534020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1074/2172] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:46 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:46.538479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.551155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9233f44-b6d4-48e3-aa06-d9d61407f8c8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.639820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.642983 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.643309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.643590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.644446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.646651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.676413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1099/2173] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:46 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:11:46.680589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.694575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fc09f-2814-41db-96a3-436db8e86e41 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.700377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.701463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.701751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.702028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.703123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.705883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.719456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1075/2174] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:46.723610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.738669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944596-4c87-47df-b25e-728100791e82 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.743816 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8b78-04c0-4437-9da9-c90fc9cf1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.744686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8b78-04c0-4437-9da9-c90fc9cf1bca admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.745032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8b78-04c0-4437-9da9-c90fc9cf1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.745312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8b78-04c0-4437-9da9-c90fc9cf1bca admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.746062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd8b78-04c0-4437-9da9-c90fc9cf1bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.748405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd8b78-04c0-4437-9da9-c90fc9cf1bca admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.770402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1100/2175] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:46.771598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.787447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99cf1-8cfd-4141-bee2-0e79b4010302 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:46.800089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:46.801701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.802196 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.802668 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] PATH_INFO: `/v3/projects/8aae5cb5d2cd4798b2d627299a7ccbc1/users/88ea3e53889047619c9c50a3ceac38ad/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.823346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aae5cb5d2cd4798b2d627299a7ccbc1, user_id=88ea3e53889047619c9c50a3ceac38ad, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:46.826124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:46.853081 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1076/2176] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:46 2022] PUT /identity/v3/projects/8aae5cb5d2cd4798b2d627299a7ccbc1/users/88ea3e53889047619c9c50a3ceac38ad/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:46.859327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890c35-1106-4ae3-9607-6e7f1fcfd786 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:46.860131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890c35-1106-4ae3-9607-6e7f1fcfd786 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:46.860701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890c35-1106-4ae3-9607-6e7f1fcfd786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:46.881168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-51890c35-1106-4ae3-9607-6e7f1fcfd786 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:46.883235 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-51890c35-1106-4ae3-9607-6e7f1fcfd786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:46.953801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1101/2177] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:46.964465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:46.966333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:47.027272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36ce71-48ef-4a78-9d95-f1ed8e3ae1e8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:47.031163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:47.031821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:47.032119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:47.032381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:47.042269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:47.043734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:47.054658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1077/2178] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:11:51.662120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:51.662743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:51.662743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:51.693005 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] MFA Rules not processed for user `88ea3e53889047619c9c50a3ceac38ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:51.694260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:51.758672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1102/2179] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:51.763553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:51.775997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896436a9-70bf-49f9-b49b-948f6ce14d64 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:51.781042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:51.781918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:51.782257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:51.782734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:51.783645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:51.785665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:51.816767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1078/2180] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:11:51 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:51.818132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:51.829648 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56de5-b3ce-40c4-a246-e3a044ff0c61 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:51.888397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:51.889733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:51.889733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:51.890357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:51.891636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:51.894835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:51.924516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1103/2181] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:11:51 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:11:51.925712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:51.936076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a10d-01bd-43fc-8fd6-f0f78eda27fd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:51.941600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:51.942346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:51.942698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:51.943040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:51.943854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:51.945583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:51.958714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1079/2182] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:11:51.962503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:51.974824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192a4e2-3fd3-4d0f-993d-f7999f1c1209 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:51.980635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:51.981593 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:51.981966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:51.982221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] PATH_INFO: `/v3/projects/aea7811f577f42db8e75bc26d2b1a764/users/1db8c9d9016044b7a218b4aa4d22599d/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:51.998928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7811f577f42db8e75bc26d2b1a764, user_id=1db8c9d9016044b7a218b4aa4d22599d, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:52.001728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:52.017326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1104/2183] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:51 2022] PUT /identity/v3/projects/aea7811f577f42db8e75bc26d2b1a764/users/1db8c9d9016044b7a218b4aa4d22599d/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:52.021413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:52.031680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8346-768e-44f9-ac41-4ebeda4e836f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:52.092118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820bb21-7969-4774-9f39-62b7703df391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:52.092924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820bb21-7969-4774-9f39-62b7703df391 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:52.093207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820bb21-7969-4774-9f39-62b7703df391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:52.093481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820bb21-7969-4774-9f39-62b7703df391 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:52.094223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820bb21-7969-4774-9f39-62b7703df391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:52.095840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820bb21-7969-4774-9f39-62b7703df391 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:52.109226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1080/2184] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:11:52.110662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:52.121616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478169c-899d-4ddc-b5ab-24351e77793f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:52.127090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:52.127996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:52.128277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:52.128554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] PATH_INFO: `/v3/projects/aea7811f577f42db8e75bc26d2b1a764/users/1db8c9d9016044b7a218b4aa4d22599d/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:52.130622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7811f577f42db8e75bc26d2b1a764, user_id=1db8c9d9016044b7a218b4aa4d22599d, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:52.133318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:52.151939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1105/2185] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:11:52 2022] PUT /identity/v3/projects/aea7811f577f42db8e75bc26d2b1a764/users/1db8c9d9016044b7a218b4aa4d22599d/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:11:58.246855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680f2d-0645-4028-a677-0ce326fea0b5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:58.247352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680f2d-0645-4028-a677-0ce326fea0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:58.247439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680f2d-0645-4028-a677-0ce326fea0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:58.325458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-96680f2d-0645-4028-a677-0ce326fea0b5 None None] MFA Rules not processed for user `1db8c9d9016044b7a218b4aa4d22599d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:11:58.326834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-96680f2d-0645-4028-a677-0ce326fea0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:58.490117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1081/2186] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:11:58.503147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:11:58.505803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:11:58.643675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fc730-7081-4908-84cd-4e6f30e2b1ff admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:11:58.664604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb992105-d191-40d0-8636-3ab2ad441c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:11:58.665423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992105-d191-40d0-8636-3ab2ad441c62 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:11:58.665703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992105-d191-40d0-8636-3ab2ad441c62 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:11:58.666167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb992105-d191-40d0-8636-3ab2ad441c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:11:58.765741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992105-d191-40d0-8636-3ab2ad441c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:11:58.767387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb992105-d191-40d0-8636-3ab2ad441c62 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:11:58.779964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1106/2187] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:11:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:12:00.215926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:00.216451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:00.216555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:00.235486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] MFA Rules not processed for user `88ea3e53889047619c9c50a3ceac38ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:00.236726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:00.244766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1082/2188] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:31.492256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:31.492818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:31.492818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:31.511400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:31.513014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:31.570577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1107/2189] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:12:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:12:31.612435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:31.614122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:31.689972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e73d0-16ab-4fd4-b955-7f3c42d81788 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:31.694947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7615f1a-346a-4b07-a3b6-f1e26fd4ea66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:31.695592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615f1a-346a-4b07-a3b6-f1e26fd4ea66 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:31.695866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615f1a-346a-4b07-a3b6-f1e26fd4ea66 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:31.696135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615f1a-346a-4b07-a3b6-f1e26fd4ea66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:31.705962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7615f1a-346a-4b07-a3b6-f1e26fd4ea66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:31.707554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7615f1a-346a-4b07-a3b6-f1e26fd4ea66 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:31.715935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1083/2190] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:12:35.684871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:35.686496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:36.029897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45eef87-5c27-44cb-9bc6-c9246e34fcdd None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:36.035284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:36.036195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:36.036470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:36.036745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] PATH_INFO: `/v3/users/788b32ff71fd41d18f9e061f0d665444` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:36.037995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=788b32ff71fd41d18f9e061f0d665444)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:36.039950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:36.103105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788b32ff71fd41d18f9e061f0d665444'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:36.110439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788b32ff71fd41d18f9e061f0d665444'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:36.123507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788b32ff71fd41d18f9e061f0d665444'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:36.135838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788b32ff71fd41d18f9e061f0d665444'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:36.136954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788b32ff71fd41d18f9e061f0d665444'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:36.146409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1108/2191] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:12:35 2022] DELETE /identity/v3/users/788b32ff71fd41d18f9e061f0d665444 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:12:36.148236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:36.148783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:36.148884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:36.180253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:36.181860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:36.256374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1084/2192] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:36.267483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:36.269424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:36.397377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b10d57-e8c0-4573-a896-250686a18c81 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:36.400022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a5618-aee0-4a81-92d6-78600a9d9971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:36.401079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a5618-aee0-4a81-92d6-78600a9d9971 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:36.401698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a5618-aee0-4a81-92d6-78600a9d9971 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:36.402084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a5618-aee0-4a81-92d6-78600a9d9971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:36.412379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a5618-aee0-4a81-92d6-78600a9d9971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:36.416153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a5618-aee0-4a81-92d6-78600a9d9971 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:36.426442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1109/2193] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:12:36.839654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:36.846626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:36.858993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf083aaf-dfb8-4343-9d4c-f224f9484c42 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:36.889570 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:36.890752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:36.892166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:36.894292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] PATH_INFO: `/v3/projects/19f2fb7fe23a462ba083d732587b863c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:36.896159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f2fb7fe23a462ba083d732587b863c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:36.898132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.003581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f2fb7fe23a462ba083d732587b863c', 'request_id': 'req-5910596b-3d11-4785-bcc4-f07d16fe4ffd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:37.023121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f2fb7fe23a462ba083d732587b863c', 'request_id': 'req-5910596b-3d11-4785-bcc4-f07d16fe4ffd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:37.036772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f2fb7fe23a462ba083d732587b863c', 'request_id': 'req-5910596b-3d11-4785-bcc4-f07d16fe4ffd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:37.058700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] The token cache is being invalidate because project 19f2fb7fe23a462ba083d732587b863c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:12:37.058941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:37.060954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5910596b-3d11-4785-bcc4-f07d16fe4ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:37.071315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1085/2194] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:12:36 2022] DELETE /identity/v3/projects/19f2fb7fe23a462ba083d732587b863c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:12:37.076188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.076668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.076766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.140928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:37.142339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:37.225801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1110/2195] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:37.227787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.228760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.229726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.249591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:37.250909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:37.263459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1086/2196] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:37.264418 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.274791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af64ef-88ec-4d69-b222-e979bc42fe37 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.282791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.283760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.284803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.285131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.285881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:12:37.286349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.288124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.302174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1111/2197] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:12:37.306590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.319949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7285422-8da6-4baf-aca8-d7aaaa244b5b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.322874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.323558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.323865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.324116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.324817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.326775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.360729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1087/2198] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:12:37 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:12:37.361123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.373664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b18de-6bbf-409f-90cf-81fd9b6ce0aa admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.464577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.465250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.465522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.465818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.466543 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.468631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.501177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1112/2199] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:12:37 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:12:37.505611 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.521040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cfd41-8179-4305-bc1c-a8fed70aaebd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.527410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.528313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.528964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.529393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.530219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.531846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.550084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1088/2200] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:12:37.550636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.566990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613de44-5157-4385-b42f-93ed4d423f30 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.583214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa7fc-58af-4834-be67-3036bcc669ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.584052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa7fc-58af-4834-be67-3036bcc669ea admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.584436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa7fc-58af-4834-be67-3036bcc669ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.584811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa7fc-58af-4834-be67-3036bcc669ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.585705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fa7fc-58af-4834-be67-3036bcc669ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.595158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fa7fc-58af-4834-be67-3036bcc669ea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.600131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1113/2201] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:12:37.605131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.616486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e915a-b3c2-4a14-b6fc-16fedeb20ba3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.621762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.622742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.623023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.623298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] PATH_INFO: `/v3/projects/0ec04898aa5f46c5b1690cb3b78ba181/users/1ca68b0414c04e9692461325b256de18/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.641855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec04898aa5f46c5b1690cb3b78ba181, user_id=1ca68b0414c04e9692461325b256de18, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.644725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.662948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1089/2202] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:12:37 2022] PUT /identity/v3/projects/0ec04898aa5f46c5b1690cb3b78ba181/users/1ca68b0414c04e9692461325b256de18/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:12:37.672892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a4636-bf73-40e9-b519-e3e9823ff5bb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.673224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a4636-bf73-40e9-b519-e3e9823ff5bb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.673497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a4636-bf73-40e9-b519-e3e9823ff5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.704032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-997a4636-bf73-40e9-b519-e3e9823ff5bb None None] MFA Rules not processed for user `1ca68b0414c04e9692461325b256de18`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:37.705647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-997a4636-bf73-40e9-b519-e3e9823ff5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:37.791928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1114/2203] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:37.806072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:37.809830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:37.886449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5917c8-06af-4379-9fc5-ca200e0a2b9e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:37.891382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:37.892055 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:37.892311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:37.892633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:37.915547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:37.917061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:37.932159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1090/2204] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:12:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:12:49.108984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb4e1-c0ce-4d22-89b5-10b04c57bfeb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:49.109891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb4e1-c0ce-4d22-89b5-10b04c57bfeb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:49.110323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb4e1-c0ce-4d22-89b5-10b04c57bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:49.147840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-aa1fb4e1-c0ce-4d22-89b5-10b04c57bfeb None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:49.149178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-aa1fb4e1-c0ce-4d22-89b5-10b04c57bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:49.212379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1115/2205] 10.222.0.30 () {58 vars in 967 bytes} [Mon Apr 4 06:12:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:49.236189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:49.238131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:49.335585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7405-8e1a-422d-8536-500f4c745f9f service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:49.340532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:49.341802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:49.341802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:49.342016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:49.354554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:49.356165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:49.368968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1091/2206] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:12:50.567506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:50.567990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:50.568094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:50.589185 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] MFA Rules not processed for user `6b909365ef3640f3b15ec4ca0e7d6d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:50.590571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:50.647452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1116/2207] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:54.685576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:54.687377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:54.770832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efe50-509e-4698-812a-5d22f3198807 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:54.782268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:54.785809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:54.786272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:54.786692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] PATH_INFO: `/v3/users/353445975d5e444bb3ce55f9d761d4b3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:54.788632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353445975d5e444bb3ce55f9d761d4b3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:54.791344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:54.859864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353445975d5e444bb3ce55f9d761d4b3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:54.867504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353445975d5e444bb3ce55f9d761d4b3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:54.883553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353445975d5e444bb3ce55f9d761d4b3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:54.884549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353445975d5e444bb3ce55f9d761d4b3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:54.885980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-66e7c241-b2f5-4609-9351-21380fce1975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353445975d5e444bb3ce55f9d761d4b3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:54.912667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1092/2208] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:12:54 2022] DELETE /identity/v3/users/353445975d5e444bb3ce55f9d761d4b3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:12:55.233369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:55.254144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1562338-72f9-437e-8c7e-163cfc2a5d02 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:55.323770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:55.325011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.325525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.325856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] PATH_INFO: `/v3/projects/ef4b8fbc23f64e5eb84517aa289e71b1` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.327276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4b8fbc23f64e5eb84517aa289e71b1)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:55.329271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:55.392628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4b8fbc23f64e5eb84517aa289e71b1', 'request_id': 'req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:55.403246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4b8fbc23f64e5eb84517aa289e71b1', 'request_id': 'req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:55.412943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4b8fbc23f64e5eb84517aa289e71b1', 'request_id': 'req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:55.429495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] The token cache is being invalidate because project ef4b8fbc23f64e5eb84517aa289e71b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:12:55.429810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:55.430605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-26b43ebe-0b4d-45a8-9f11-e2561dfa4b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:12:55.432857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1117/2209] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:12:55 2022] DELETE /identity/v3/projects/ef4b8fbc23f64e5eb84517aa289e71b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:12:55.437675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.438032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.438314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.506021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:55.508867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:55.593089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1093/2210] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:55.602491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.602834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.603406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.643813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:55.643813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:55.650815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1118/2211] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:55.655375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:55.673203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489105f6-6e80-405a-9a50-23f656a3d814 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:55.683540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:55.684195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.684486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.684791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.685705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:12:55.686309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:55.689112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:55.716235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1094/2212] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:12:55.719881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:55.730047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455d91c-dfa1-481c-a943-ff5c87d2a6ea None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:55.735806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:55.736718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.737304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.738009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.739565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:55.741704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:55.804942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1119/2213] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:12:55 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:12:55.809077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:55.830520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fa941-a503-4354-9dea-6f4bad75fda4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:55.905687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:55.906545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.906924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.907301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.908344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:55.910712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:55.937253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1095/2214] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:12:55 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:12:55.941143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:55.954856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4efe-eebe-4691-9b15-0dabd3d9986c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:55.960158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:55.961138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:55.961485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:55.961957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:55.962880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:55.964721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:55.978019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1120/2215] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:12:55.983212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:55.998688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a71d-bba5-40b3-88bf-06500d2cdcab admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:56.006907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d22863-4bc2-4159-a505-3c1043b34b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:56.007607 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d22863-4bc2-4159-a505-3c1043b34b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:56.007890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d22863-4bc2-4159-a505-3c1043b34b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:56.008160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d22863-4bc2-4159-a505-3c1043b34b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:56.009391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d22863-4bc2-4159-a505-3c1043b34b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:56.011730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d22863-4bc2-4159-a505-3c1043b34b92 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:56.038444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1096/2216] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:12:56.040756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:56.051493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34c16-2482-4868-b1f2-039c7b54328c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:56.056519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:56.057669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:56.058142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:56.058652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] PATH_INFO: `/v3/projects/206f8038ff2043ac9aa6207ac10a5b48/users/69ea8bedcda940bcb5e56578d2c36f59/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:56.075421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206f8038ff2043ac9aa6207ac10a5b48, user_id=69ea8bedcda940bcb5e56578d2c36f59, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:56.078117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:56.097026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1121/2217] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:12:56 2022] PUT /identity/v3/projects/206f8038ff2043ac9aa6207ac10a5b48/users/69ea8bedcda940bcb5e56578d2c36f59/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:12:56.105755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:56.106042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:56.106472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:56.138815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] MFA Rules not processed for user `69ea8bedcda940bcb5e56578d2c36f59`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:12:56.140300 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:56.228973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1097/2218] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:12:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:12:56.240871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:12:56.242848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:12:56.301849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3593bd0-6ad0-4f24-9fd9-605811776930 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:12:56.305559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:12:56.306240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:12:56.306516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:12:56.306787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:12:56.315271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:12:56.316737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:12:56.332478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1122/2219] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:12:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:13:09.635382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:13:09.637284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:13:09.732624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63af9d4-d40d-4d25-8f4b-79e80f33cf10 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:13:09.738194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:13:09.738857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:13:09.739137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:13:09.739415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:13:09.741268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:13:09.753682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:13:09.755278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa3f4d-8153-4a22-92b9-1a5bfe0e9a52 service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:13:09.766921 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1098/2220] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:13:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:13:38.020595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:13:38.022321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:13:38.097110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454ecda-d3ad-45e9-a2ba-0b4f416dc84a service glance] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:13:38.104206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:13:38.105169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:13:38.105614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:13:38.105964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:13:38.109103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:13:38.176744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:13:38.178055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:13:38.189126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1123/2221] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:13:45.625935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fbf21-62ed-4f22-afd7-23741da6efa1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:13:45.626577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fbf21-62ed-4f22-afd7-23741da6efa1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:13:45.626577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fbf21-62ed-4f22-afd7-23741da6efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:13:45.646153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c20fbf21-62ed-4f22-afd7-23741da6efa1 None None] MFA Rules not processed for user `5e0d7a6c850f4fef88d123fec8665d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:13:45.647369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c20fbf21-62ed-4f22-afd7-23741da6efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:13:45.708929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1099/2222] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:13:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:01.071129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:01.148494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149978-ffd9-488b-828a-6f284590e774 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:01.153910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:01.154779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:01.155053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:01.155322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] PATH_INFO: `/v3/users/69ea8bedcda940bcb5e56578d2c36f59` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:01.156532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ea8bedcda940bcb5e56578d2c36f59)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:01.158481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:01.205165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ea8bedcda940bcb5e56578d2c36f59'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.212752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ea8bedcda940bcb5e56578d2c36f59'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.225430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ea8bedcda940bcb5e56578d2c36f59'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.234144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ea8bedcda940bcb5e56578d2c36f59'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.234763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ea8bedcda940bcb5e56578d2c36f59'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.241014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1124/2223] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:14:01 2022] DELETE /identity/v3/users/69ea8bedcda940bcb5e56578d2c36f59 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:14:01.246684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:01.247165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:01.247259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:01.275619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:14:01.276822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:01.341915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1100/2224] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:01.352288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:01.353834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:01.418678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb0343-c46c-4e80-aed4-4635aacce4fe admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:01.422984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:01.423649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:01.423925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:01.424198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:01.433988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:01.435455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:01.445972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1125/2225] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:14:01.756058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:01.758551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:01.786138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f2656-15af-4728-899f-90c2c7fba5ad None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:01.792945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:01.793837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:01.794134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:01.794407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] PATH_INFO: `/v3/projects/206f8038ff2043ac9aa6207ac10a5b48` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:01.795632 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] RBAC: Authorizing `identity:delete_project(project_id=206f8038ff2043ac9aa6207ac10a5b48)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:01.797605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:01.856215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206f8038ff2043ac9aa6207ac10a5b48', 'request_id': 'req-78a6c3e0-791e-44c2-8f62-9670724c015b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.864849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206f8038ff2043ac9aa6207ac10a5b48', 'request_id': 'req-78a6c3e0-791e-44c2-8f62-9670724c015b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.871831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206f8038ff2043ac9aa6207ac10a5b48', 'request_id': 'req-78a6c3e0-791e-44c2-8f62-9670724c015b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.883142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] The token cache is being invalidate because project 206f8038ff2043ac9aa6207ac10a5b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:14:01.883428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.884080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a6c3e0-791e-44c2-8f62-9670724c015b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:01.886018 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1101/2226] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:14:01 2022] DELETE /identity/v3/projects/206f8038ff2043ac9aa6207ac10a5b48 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:14:02.448677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:02.450359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:02.463842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bb33b-af29-4a81-8189-fb862176634a service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:02.524551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:02.525456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:02.525726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:02.525990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] PATH_INFO: `/v3/users/1ca68b0414c04e9692461325b256de18` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:02.527256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca68b0414c04e9692461325b256de18)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:02.529193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:02.581479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca68b0414c04e9692461325b256de18'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:02.589203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca68b0414c04e9692461325b256de18'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:02.602144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca68b0414c04e9692461325b256de18'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:02.611705 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca68b0414c04e9692461325b256de18'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:02.612377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca68b0414c04e9692461325b256de18'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:02.618664 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1126/2227] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:14:02 2022] DELETE /identity/v3/users/1ca68b0414c04e9692461325b256de18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:14:02.623125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:02.623622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:02.623718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:02.642111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:14:02.643305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:02.715635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1102/2228] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:02.725478 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:02.727156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:02.791220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e86e-c481-465f-8a8a-dadfa97d6752 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:02.796086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b1e4e-381b-4825-98d5-5fac57387eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:02.796727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b1e4e-381b-4825-98d5-5fac57387eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:02.797039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b1e4e-381b-4825-98d5-5fac57387eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:02.797638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b1e4e-381b-4825-98d5-5fac57387eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:02.807880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b1e4e-381b-4825-98d5-5fac57387eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:02.809359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b1e4e-381b-4825-98d5-5fac57387eb0 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:02.820158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1127/2229] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:14:03.104729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.106215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:03.118846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68db7b7-0252-48b3-83a6-6c433203afad None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.123688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.124556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.124837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.125145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] PATH_INFO: `/v3/projects/0ec04898aa5f46c5b1690cb3b78ba181` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.126329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec04898aa5f46c5b1690cb3b78ba181)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.128240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.176047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec04898aa5f46c5b1690cb3b78ba181', 'request_id': 'req-4d7b2965-1b47-479f-8961-220d5bc1e21d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:03.185039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec04898aa5f46c5b1690cb3b78ba181', 'request_id': 'req-4d7b2965-1b47-479f-8961-220d5bc1e21d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:03.192006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec04898aa5f46c5b1690cb3b78ba181', 'request_id': 'req-4d7b2965-1b47-479f-8961-220d5bc1e21d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:03.203488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] The token cache is being invalidate because project 0ec04898aa5f46c5b1690cb3b78ba181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:14:03.203772 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:03.204463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4d7b2965-1b47-479f-8961-220d5bc1e21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:03.206119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1103/2230] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:14:03 2022] DELETE /identity/v3/projects/0ec04898aa5f46c5b1690cb3b78ba181 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:14:03.211263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90218726-3917-454c-819c-8b1e013da239 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.211572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90218726-3917-454c-819c-8b1e013da239 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.211845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90218726-3917-454c-819c-8b1e013da239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.230520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-90218726-3917-454c-819c-8b1e013da239 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:14:03.231727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-90218726-3917-454c-819c-8b1e013da239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:03.297508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1128/2231] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:03.305699 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.305991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.306271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.325414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:14:03.326624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:03.335922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1104/2232] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:03.340228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90218726-3917-454c-819c-8b1e013da239 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.350065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90218726-3917-454c-819c-8b1e013da239 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.355318 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.355969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.356245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.356495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.357256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:14:03.357559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.359186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.370813 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1129/2233] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:14:03.375190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.385662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49c6c0-9fc3-4f62-aff4-fd09e169d93d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.391682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.392340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.392616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.392885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.393607 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.395526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.425847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1105/2234] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:14:03 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:14:03.431949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.447730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff3bf-0c6b-4e35-b5e7-da24365799d7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.516267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.516995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.517221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.517494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.518181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.520087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.540399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1130/2235] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:14:03 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:14:03.546847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.558464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d574-7a54-4b49-82b3-0bc79813bddd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.563347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.564004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.564313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.564603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.565355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.566952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.578004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1106/2236] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:14:03.582352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.592993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bfe5f-54ac-4238-ba00-ab56466bccc0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.598406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def520b-deb0-48bf-942a-a7df0fd6f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.599072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def520b-deb0-48bf-942a-a7df0fd6f1ae admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.599347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def520b-deb0-48bf-942a-a7df0fd6f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.599617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def520b-deb0-48bf-942a-a7df0fd6f1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.600408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def520b-deb0-48bf-942a-a7df0fd6f1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.601992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def520b-deb0-48bf-942a-a7df0fd6f1ae admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.613310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1131/2237] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:14:03.617711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.628690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831c67-1dec-4047-91e9-344b88a6f2fd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.635130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.635994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.636271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.636559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] PATH_INFO: `/v3/projects/17776e367b944057b3c8b7f688efcf96/users/dea95225ca2e4366b6fc564a304a7bd7/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.652642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17776e367b944057b3c8b7f688efcf96, user_id=dea95225ca2e4366b6fc564a304a7bd7, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.655373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.671144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1107/2238] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:14:03 2022] PUT /identity/v3/projects/17776e367b944057b3c8b7f688efcf96/users/dea95225ca2e4366b6fc564a304a7bd7/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:14:03.682420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.682694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.682967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.710536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] MFA Rules not processed for user `dea95225ca2e4366b6fc564a304a7bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:14:03.712263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:03.779359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1132/2239] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:03.791288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:03.793257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:03.874060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98887ac-2d8f-44e5-af66-8fb2ccf99d0e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:03.877969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30ac91-292f-4dd6-8881-f8c104ece9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:03.878616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30ac91-292f-4dd6-8881-f8c104ece9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:03.879050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30ac91-292f-4dd6-8881-f8c104ece9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:03.879268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30ac91-292f-4dd6-8881-f8c104ece9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:03.888853 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30ac91-292f-4dd6-8881-f8c104ece9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:03.890333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30ac91-292f-4dd6-8881-f8c104ece9f2 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:03.899419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1108/2240] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:14:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:14:36.731174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:36.798533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c9053-5363-47e6-8d68-1832f1d779f6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:36.803571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:36.804514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:36.804785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:36.805099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] PATH_INFO: `/v3/users/dea95225ca2e4366b6fc564a304a7bd7` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:36.806409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea95225ca2e4366b6fc564a304a7bd7)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:36.808355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:36.855929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea95225ca2e4366b6fc564a304a7bd7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:36.862511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea95225ca2e4366b6fc564a304a7bd7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:36.874853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea95225ca2e4366b6fc564a304a7bd7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:36.884942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea95225ca2e4366b6fc564a304a7bd7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:36.885623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea95225ca2e4366b6fc564a304a7bd7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:36.891909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1133/2241] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:14:36 2022] DELETE /identity/v3/users/dea95225ca2e4366b6fc564a304a7bd7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:14:36.896656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:36.897198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:36.897297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:36.915636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:14:36.916848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:36.979556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1109/2242] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:14:36.992503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:36.994186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:37.067157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505cef-509a-405f-8adc-2019f2118300 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:37.071864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:37.073697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:37.074898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:37.076278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:37.087240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:37.088674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:37.098176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1134/2243] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:14:37.377966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:14:37.379457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:14:37.393014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701891-c948-4bbe-b400-1ca96c0abe17 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:14:37.399830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:14:37.400704 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:14:37.401010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:14:37.401275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] PATH_INFO: `/v3/projects/17776e367b944057b3c8b7f688efcf96` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:14:37.402513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17776e367b944057b3c8b7f688efcf96)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:14:37.405383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:14:37.464167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17776e367b944057b3c8b7f688efcf96', 'request_id': 'req-502c421a-b610-403a-acfa-60de23b64781'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:37.474651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17776e367b944057b3c8b7f688efcf96', 'request_id': 'req-502c421a-b610-403a-acfa-60de23b64781'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:37.481145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17776e367b944057b3c8b7f688efcf96', 'request_id': 'req-502c421a-b610-403a-acfa-60de23b64781'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:37.492840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] The token cache is being invalidate because project 17776e367b944057b3c8b7f688efcf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:14:37.493291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:37.494201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:14:37.496277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1110/2244] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:14:37 2022] DELETE /identity/v3/projects/17776e367b944057b3c8b7f688efcf96 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:15:01.408999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:01.410584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:01.422630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e7b10-5ea7-4f7f-8a59-c9aaa4a9a415 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:01.474650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:01.475299 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:01.475567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:01.475833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:01.477818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:01.567075 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:01.568519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:01.588408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1135/2245] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:05.177777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:05.179509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:05.193411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c421a-b610-403a-acfa-60de23b64781 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:05.197774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:05.198422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:05.198703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:05.198977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:05.200828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:05.214968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:05.216390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:05.228749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1111/2246] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:08.684120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:08.685704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:08.752449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7feba-f5e6-4171-8003-302c275a68db service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:08.758511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:08.759384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:08.759656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:08.759925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] PATH_INFO: `/v3/users/5e0d7a6c850f4fef88d123fec8665d33` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:08.761264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0d7a6c850f4fef88d123fec8665d33)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:08.763471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:08.814681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0d7a6c850f4fef88d123fec8665d33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:08.822751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0d7a6c850f4fef88d123fec8665d33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:08.835166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0d7a6c850f4fef88d123fec8665d33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:08.842753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0d7a6c850f4fef88d123fec8665d33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:08.843748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0d7a6c850f4fef88d123fec8665d33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:08.851807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1136/2247] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:15:08 2022] DELETE /identity/v3/users/5e0d7a6c850f4fef88d123fec8665d33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:15:09.038115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:09.048684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8331-f82f-4d8b-8ae3-4e6250a80fae service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:09.103650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:09.104510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:09.104788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:09.105089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] PATH_INFO: `/v3/projects/cc83aab360054a7f959ceeb6c566de89` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:09.106264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc83aab360054a7f959ceeb6c566de89)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:09.108175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:09.158849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc83aab360054a7f959ceeb6c566de89', 'request_id': 'req-7114bb34-377b-41ad-b160-46c5a1cd0d48'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:09.166438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc83aab360054a7f959ceeb6c566de89', 'request_id': 'req-7114bb34-377b-41ad-b160-46c5a1cd0d48'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:09.172508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc83aab360054a7f959ceeb6c566de89', 'request_id': 'req-7114bb34-377b-41ad-b160-46c5a1cd0d48'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:09.182491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] The token cache is being invalidate because project cc83aab360054a7f959ceeb6c566de89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:15:09.182770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:09.183389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:15:09.184883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1112/2248] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:15:09 2022] DELETE /identity/v3/projects/cc83aab360054a7f959ceeb6c566de89 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:15:14.370651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:14.372327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:14.446742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8cc15-e456-4686-8b7a-9a3430b01c64 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:14.508678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:14.509344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:14.509617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:14.509888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:14.511827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:14.577586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:14.579182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4cc7a-de10-4fa0-92bc-078a5bef18d6 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:14.588436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1137/2249] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:14.809891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:14.811405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:14.828672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114bb34-377b-41ad-b160-46c5a1cd0d48 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:14.835750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:14.836394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:14.836693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:14.837004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:14.839023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:14.902208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:14.903816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:14.913337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1113/2250] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:18.712957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:18.713423 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:18.713515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:18.764488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:15:18.765749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:18.833177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1138/2251] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:15:18.890325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:18.891981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:18.982773 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cde77d-5bad-43f6-8105-20f3cdf3ff14 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:18.990969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceacd1-1971-4b9a-bd0c-bc3891f74420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:18.992170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceacd1-1971-4b9a-bd0c-bc3891f74420 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:18.992629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceacd1-1971-4b9a-bd0c-bc3891f74420 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:18.993040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceacd1-1971-4b9a-bd0c-bc3891f74420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:19.007419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ceacd1-1971-4b9a-bd0c-bc3891f74420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:19.009884 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ceacd1-1971-4b9a-bd0c-bc3891f74420 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:19.018839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1114/2252] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:15:34.930150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:34.931761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:34.991503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5e57-cdda-4330-913a-850c59f4931b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:34.996162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:34.996833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:34.997140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:34.997420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:34.999581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.011057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:35.012640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9f550-f456-462d-a1d3-5fc33460d010 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:35.020686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1139/2253] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:35.141228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097ff4-e34e-4dc1-bc7c-bb429520c4b8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.141822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097ff4-e34e-4dc1-bc7c-bb429520c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.141822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7097ff4-e34e-4dc1-bc7c-bb429520c4b8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.154135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1115/2254] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:15:35 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:15:35.160631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f18c-061a-4a29-a76a-93b76bd3a953 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.160925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f18c-061a-4a29-a76a-93b76bd3a953 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.161213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f18c-061a-4a29-a76a-93b76bd3a953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.204207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0f01f18c-061a-4a29-a76a-93b76bd3a953 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:15:35.205439 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0f01f18c-061a-4a29-a76a-93b76bd3a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.216102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1140/2255] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:15:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:15:35.227902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097ff4-e34e-4dc1-bc7c-bb429520c4b8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:35.230066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d7097ff4-e34e-4dc1-bc7c-bb429520c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.309946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7097ff4-e34e-4dc1-bc7c-bb429520c4b8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:35.313416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9b6d7-4079-4939-87a7-b234999bf0e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:35.314058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b6d7-4079-4939-87a7-b234999bf0e7 service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.314332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b6d7-4079-4939-87a7-b234999bf0e7 service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.314598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9b6d7-4079-4939-87a7-b234999bf0e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.324671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9b6d7-4079-4939-87a7-b234999bf0e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:35.326125 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9b6d7-4079-4939-87a7-b234999bf0e7 service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:35.336692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1116/2256] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:35.408872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f55f13-e8c5-49a0-85cb-0951236ef19d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.409188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f55f13-e8c5-49a0-85cb-0951236ef19d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.409462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f55f13-e8c5-49a0-85cb-0951236ef19d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.411256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1141/2257] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:15:35.416242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bab2f-1117-4ebc-8e1b-9bc0e5359ee3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.416524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bab2f-1117-4ebc-8e1b-9bc0e5359ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.416795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bab2f-1117-4ebc-8e1b-9bc0e5359ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.434963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d66bab2f-1117-4ebc-8e1b-9bc0e5359ee3 None None] MFA Rules not processed for user `6ada2f7acb1349e38b96dfbda5546101`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:15:35.436157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d66bab2f-1117-4ebc-8e1b-9bc0e5359ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.443740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1117/2258] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:15:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:15:35.456630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f55f13-e8c5-49a0-85cb-0951236ef19d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:35.475878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f55f13-e8c5-49a0-85cb-0951236ef19d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:35.482159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223bb0a-3bd3-45c2-af68-026d9240de25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:35.482803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223bb0a-3bd3-45c2-af68-026d9240de25 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.483085 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223bb0a-3bd3-45c2-af68-026d9240de25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.483358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223bb0a-3bd3-45c2-af68-026d9240de25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.491304 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223bb0a-3bd3-45c2-af68-026d9240de25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:35.492749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223bb0a-3bd3-45c2-af68-026d9240de25 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:35.500935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1142/2259] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:35.601808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e813c-f0f5-48c8-9123-d079c284e20d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.602068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e813c-f0f5-48c8-9123-d079c284e20d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.602344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e813c-f0f5-48c8-9123-d079c284e20d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.604222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1118/2260] 10.222.0.30 () {54 vars in 921 bytes} [Mon Apr 4 06:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 04 06:15:35.609923 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.610188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.610467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.630246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] MFA Rules not processed for user `07287811d9ef4e04bd62a665d642b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:15:35.631437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.644135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1143/2261] 10.222.0.30 () {58 vars in 1018 bytes} [Mon Apr 4 06:15:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:15:35.654861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e813c-f0f5-48c8-9123-d079c284e20d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:35.657031 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-347e813c-f0f5-48c8-9123-d079c284e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.672342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e813c-f0f5-48c8-9123-d079c284e20d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:35.676406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:35.677078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.677359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.677633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.688124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:35.689609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:35.700687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1119/2262] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:35.770033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:35.772055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.841545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827cefb-c769-4b67-9dc3-16aba7a9ca15 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:35.849238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:35.850147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:35.850504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:35.850811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:35.854047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:35.872050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:35.873618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5f18-179a-43c4-a818-099c443eac39 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:35.884102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1144/2263] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:15:37.265209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:37.274295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772ca0-8083-4167-ba0a-bfb904bd446a service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:37.278939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:37.279574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:37.279854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:37.280115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:37.282192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:37.291910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:37.293361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:37.301837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1120/2264] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:15:38.230968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:38.231768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:38.232048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:38.250775 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:15:38.252712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:38.266329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1145/2265] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:15:38.281224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:38.293607 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994d5f0-7cda-4f7e-8d0d-f2f0847aa867 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:38.299655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:38.300311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:38.300590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:38.300859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:38.309889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:38.311457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:38.319680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1121/2266] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 04 06:15:48.511313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:15:48.528394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157a305-3997-4364-8096-bae7ddaf6737 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:15:48.534008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:15:48.534690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:15:48.534964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:15:48.535233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:15:48.537115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:15:48.595715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:15:48.597260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc469ba-29c3-4997-b805-c3ce1482328e service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:15:48.607116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1146/2267] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:15:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:16:04.154678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:16:04.156422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:04.174450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000555-8988-4851-9f97-d799a61e850f service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:16:04.180381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:16:04.181323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:04.182041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:04.182478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:04.184548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:04.198729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:16:04.200368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:16:04.212147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1122/2268] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:16:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:16:06.457469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de337b-7988-4957-b12b-4f53e1130977 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:06.457999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de337b-7988-4957-b12b-4f53e1130977 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:06.457999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de337b-7988-4957-b12b-4f53e1130977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:06.476750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-30de337b-7988-4957-b12b-4f53e1130977 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:16:06.478171 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-30de337b-7988-4957-b12b-4f53e1130977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:06.485805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1147/2269] 10.222.0.30 () {58 vars in 967 bytes} [Mon Apr 4 06:16:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:16:06.498392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:16:06.510014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9de3-dc5d-4fca-9461-88af91897af7 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:16:06.514890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:16:06.515682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:06.515959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:06.516231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:06.524714 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:16:06.528272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:16:06.538654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1123/2270] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:16:09.241036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:09.241536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:09.241645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:09.260459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] MFA Rules not processed for user `cea36666ab2947d8bf2a6abbc197be7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:16:09.261692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:09.317152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1148/2271] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:16:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:16:12.448592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:16:12.472108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda0a8-b6ea-461f-b78a-9a14c7df72bf service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:16:12.479408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:16:12.480774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:12.481827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:12.482186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:12.484186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:12.499833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:16:12.501591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87e6b6-ba90-4c62-9993-b981a5fbc891 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:16:12.513574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1124/2272] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:16:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:16:22.092342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:16:22.106511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2567807-11ac-4f92-b99f-cdb78ca42cf0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:16:22.113126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:16:22.113898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:22.114233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:22.114571 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:22.116492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:22.129552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:16:22.131606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:16:22.143641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1149/2273] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:16:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:16:26.993526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:16:26.994063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:16:26.994063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:16:27.013619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] MFA Rules not processed for user `6b909365ef3640f3b15ec4ca0e7d6d33`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:16:27.014842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:16:27.023074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1125/2274] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:16:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:17:04.064063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:04.078145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f78e5-ff01-4800-af62-366ab14a98cb service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:04.085509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:04.086326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:04.086632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:04.086903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:04.088849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:04.148253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:04.149967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73422a-6a5a-425a-a0df-8b14df731b18 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:04.158982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1150/2275] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:17:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:17:17.680501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:17.692634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48abf50-fd9b-4f38-8251-0565c39175bf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:17.697510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:17.698194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:17.698512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:17.698778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:17.700881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:17.711140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:17.712613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:17.720798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1126/2276] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:17:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:17:22.049569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:22.050138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:22.050138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:22.068880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] MFA Rules not processed for user `8d1c1bb5571f4b5cbde6b417c04ac484`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:17:22.070251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:22.077426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1151/2277] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:17:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:17:51.645361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:51.659875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5f65-8eed-45b9-b9b1-54a446c330b3 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:51.666850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:51.667495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:51.667774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:51.668049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:51.670161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:51.681706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:51.683320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:51.693534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1127/2278] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:17:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:17:54.410957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:54.421232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc80d-6a55-468c-b9c8-f674a100d58b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:54.425769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:54.426422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:54.426726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:54.426997 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:54.429132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:54.501545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:54.503118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:54.513426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1152/2279] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:17:58.364158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:58.365614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:58.381667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b37ec-841c-49ef-9c71-da3f90726a1b service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:58.386820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:58.387721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:58.387991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:58.388259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] PATH_INFO: `/v3/users/6b909365ef3640f3b15ec4ca0e7d6d33` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:58.389547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b909365ef3640f3b15ec4ca0e7d6d33)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:58.391558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:58.442981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b909365ef3640f3b15ec4ca0e7d6d33'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.450593 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b909365ef3640f3b15ec4ca0e7d6d33'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.460622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b909365ef3640f3b15ec4ca0e7d6d33'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.461530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b909365ef3640f3b15ec4ca0e7d6d33'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.462280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d6f47b70-1afa-4ea0-8b21-5285a9c796d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b909365ef3640f3b15ec4ca0e7d6d33'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.482901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1128/2280] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:17:58 2022] DELETE /identity/v3/users/6b909365ef3640f3b15ec4ca0e7d6d33 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:17:58.675323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:58.686752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cc0a-6e59-4c32-92f6-a6191b217d29 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:58.749166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:58.749972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:58.750248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:58.750513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] PATH_INFO: `/v3/projects/f97d1852193346c6916d9747f0c3b84f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:58.751702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97d1852193346c6916d9747f0c3b84f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:58.754163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:58.809366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97d1852193346c6916d9747f0c3b84f', 'request_id': 'req-274a4ae5-df57-43b5-a53c-5be30a20d985'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.819702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97d1852193346c6916d9747f0c3b84f', 'request_id': 'req-274a4ae5-df57-43b5-a53c-5be30a20d985'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.825482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97d1852193346c6916d9747f0c3b84f', 'request_id': 'req-274a4ae5-df57-43b5-a53c-5be30a20d985'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.837889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] The token cache is being invalidate because project f97d1852193346c6916d9747f0c3b84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:17:58.838172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.838910 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-274a4ae5-df57-43b5-a53c-5be30a20d985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:17:58.840992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1153/2281] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:17:58 2022] DELETE /identity/v3/projects/f97d1852193346c6916d9747f0c3b84f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:17:58.846247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:58.846640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:58.847119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:58.866368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:17:58.867571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:58.931977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1129/2282] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:17:58.940449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:58.940740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:58.941307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:58.961993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:17:58.964341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:58.972573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1154/2283] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:17:58.976926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:58.987028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe7d79-5902-4221-b935-40710c94a6af None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:58.992014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:58.992689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:58.992983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:58.993257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:58.994024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:17:58.994349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:58.996449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.009473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1130/2284] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:17:59.013969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:59.024224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe03de-0634-41fe-a278-d3b72f43403b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:59.030552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:59.031213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.031487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.031897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.033122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:59.035460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.077440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1155/2285] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:17:59 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:17:59.082069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:59.092017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46477bb1-cf4b-4197-b812-38a7b8072f6d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:59.161564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:59.162339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.162635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.162904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.163596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:59.165563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.187720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1131/2286] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:17:59 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:17:59.192328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:59.202952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed77743-3026-4694-8a4c-1adadf0af426 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:59.207674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:59.208323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.208596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.208861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.209618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:59.211196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.221014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1156/2287] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:17:59.225354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:59.235519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f84d5-4b3b-43ac-be12-546f31b09d33 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:59.240826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f5d8f-38d6-4831-8d97-9a1f7788373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:59.241514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f5d8f-38d6-4831-8d97-9a1f7788373b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.241796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f5d8f-38d6-4831-8d97-9a1f7788373b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.242044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f5d8f-38d6-4831-8d97-9a1f7788373b admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.242788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f5d8f-38d6-4831-8d97-9a1f7788373b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:59.244358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f5d8f-38d6-4831-8d97-9a1f7788373b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.255156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1132/2288] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:17:59.259415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:59.269450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af787ea-638e-4708-9a01-e6e665b33294 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:59.274192 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:59.275078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.275351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.275618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] PATH_INFO: `/v3/projects/37cbfd3b6fa34bb1a418dab64944e6f2/users/ede4535a064946759b1a07b6ee664ba0/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.291260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cbfd3b6fa34bb1a418dab64944e6f2, user_id=ede4535a064946759b1a07b6ee664ba0, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:59.293992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.308511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1157/2289] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:17:59 2022] PUT /identity/v3/projects/37cbfd3b6fa34bb1a418dab64944e6f2/users/ede4535a064946759b1a07b6ee664ba0/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:17:59.319716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.320002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.320276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.350671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] MFA Rules not processed for user `ede4535a064946759b1a07b6ee664ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:17:59.351886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:59.431746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1133/2290] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:17:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:17:59.443164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:17:59.445190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:17:59.525054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c23c3-cb17-4ce9-9598-51393a216743 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:17:59.530667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80ffcd-31d4-4d9c-99cf-a3a991934668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:17:59.531317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ffcd-31d4-4d9c-99cf-a3a991934668 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:17:59.531596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ffcd-31d4-4d9c-99cf-a3a991934668 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:17:59.531856 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ffcd-31d4-4d9c-99cf-a3a991934668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:17:59.541320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80ffcd-31d4-4d9c-99cf-a3a991934668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:17:59.542925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80ffcd-31d4-4d9c-99cf-a3a991934668 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:17:59.552174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1158/2291] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:17:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:08.971129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:09.041077 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44108b2d-619a-48eb-a263-59ce52979076 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:09.046338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:09.047330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:09.047791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:09.048061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] PATH_INFO: `/v3/users/ede4535a064946759b1a07b6ee664ba0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:09.049415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede4535a064946759b1a07b6ee664ba0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:09.051486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:09.107875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede4535a064946759b1a07b6ee664ba0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:09.115526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede4535a064946759b1a07b6ee664ba0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:09.124813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede4535a064946759b1a07b6ee664ba0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:09.125610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede4535a064946759b1a07b6ee664ba0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:09.126344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f43381df-a40f-4433-b8bd-32d69c24f8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede4535a064946759b1a07b6ee664ba0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:09.145496 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1134/2292] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:18:08 2022] DELETE /identity/v3/users/ede4535a064946759b1a07b6ee664ba0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:09.150074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:09.150583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:09.150665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:09.179188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:09.180411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:09.194298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:09.194583 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:09.194855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:09.215642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] MFA Rules not processed for user `cea36666ab2947d8bf2a6abbc197be7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:09.217289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:09.254134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1159/2293] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:18:09.266089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:09.267945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:09.281050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1135/2294] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:18:09.348032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea65d0b-dfdc-4d30-b855-b06598ddb731 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:09.357046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770a541-e770-4932-b128-e41ac986cd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:09.357715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a541-e770-4932-b128-e41ac986cd7b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:09.357992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a541-e770-4932-b128-e41ac986cd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:09.358260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770a541-e770-4932-b128-e41ac986cd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:09.377699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770a541-e770-4932-b128-e41ac986cd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:09.380234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770a541-e770-4932-b128-e41ac986cd7b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:09.392002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1160/2295] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:09.980532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:09.982797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:10.000135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44039-1604-4c8e-bea1-c9077a1947ea None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.009449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.010407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.010682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.010957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] PATH_INFO: `/v3/projects/37cbfd3b6fa34bb1a418dab64944e6f2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.016786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cbfd3b6fa34bb1a418dab64944e6f2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.018761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.086064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cbfd3b6fa34bb1a418dab64944e6f2', 'request_id': 'req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:10.099297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cbfd3b6fa34bb1a418dab64944e6f2', 'request_id': 'req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:10.113965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cbfd3b6fa34bb1a418dab64944e6f2', 'request_id': 'req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:10.126928 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] The token cache is being invalidate because project 37cbfd3b6fa34bb1a418dab64944e6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:18:10.127222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:10.128049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-babc71ea-ef3b-4e6b-a095-aa40ebc7176d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:10.130260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1136/2296] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:18:09 2022] DELETE /identity/v3/projects/37cbfd3b6fa34bb1a418dab64944e6f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:10.135473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.135754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.136044 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.156398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:10.157680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:10.230465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1161/2297] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:10.232337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.232786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.233259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.252382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:10.254233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:10.264306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1137/2298] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:10.269395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.280620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4fc37-9428-45c1-9c1c-35942d730eb6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.286371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.287115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.287456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.287960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.288757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:18:10.289163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.291072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.304356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1162/2299] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:18:10.308828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.319353 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeb718-1272-4658-9acb-d640a0f925fb None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.328458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.329269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.329638 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.330029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.330809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.333310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.364829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1138/2300] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:10.366386 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.377550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd670a1d-8b4f-4e8b-8812-7aa2390e175d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.437135 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.438083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.438539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.438985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.439828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.442088 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.470208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1163/2301] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:10.471687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.483168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d9fda-fc34-4aa4-9a50-9b252f5ef304 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.489357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.490084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.490372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.490649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.491419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.493063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.507715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1139/2302] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:18:10.507875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.507875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:10.509442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.522033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6b27-4ed5-4943-89bd-d97967c0de51 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.527799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.528535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.528819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.529123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.533440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.535108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.546344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1140/2303] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:18:10.550343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.562245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62144275-8063-4cad-8b3d-20526a4c2623 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.567023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf1329-ce32-4590-97f3-2512708fb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.567912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf1329-ce32-4590-97f3-2512708fb33d admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.568220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf1329-ce32-4590-97f3-2512708fb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.568494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf1329-ce32-4590-97f3-2512708fb33d admin admin] PATH_INFO: `/v3/projects/08dff8feea734c44ac18138c5f7d993a/users/b34e6f75cf71436db4be21cb8be13c33/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.584231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf1329-ce32-4590-97f3-2512708fb33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dff8feea734c44ac18138c5f7d993a, user_id=b34e6f75cf71436db4be21cb8be13c33, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.586922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf1329-ce32-4590-97f3-2512708fb33d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.587289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22503dd-a02f-4708-ba7d-2d746b89990e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.593824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.594535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.594846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.595147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.597112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:10.603070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1141/2304] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:18:10 2022] PUT /identity/v3/projects/08dff8feea734c44ac18138c5f7d993a/users/b34e6f75cf71436db4be21cb8be13c33/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:18:10.618568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.620003 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.620654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.621779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.623448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.637843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1164/2305] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:10.662061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] MFA Rules not processed for user `b34e6f75cf71436db4be21cb8be13c33`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:10.664395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:10.759989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1142/2306] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:10.764541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.780466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ef2b-d077-4911-b582-8338795e9f73 service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.851594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.852267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.852542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.852853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.853524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.855467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.886610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1165/2307] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:10.887874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:10.899795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866b30b-5774-4acd-9dca-05f64af3b421 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:10.961371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:10.962061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:10.962344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:10.962622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:10.963326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:10.965291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:10.990801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1143/2308] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:18:10 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:10.992229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:11.004226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c894ee7-1750-4a11-8763-8091c584d85a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:11.020127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:11.021442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.021725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.021985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.022724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:11.024374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:11.037507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1166/2309] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:18:11.041765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:11.053326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccf811-e591-4337-b9c4-e17f09b92b78 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:11.058623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:11.059625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.060093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.060637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] PATH_INFO: `/v3/projects/15a699a9214845a58676d1e26e9871aa/users/7f00c627c6d440c1abc249e79cc43443/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.078267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a699a9214845a58676d1e26e9871aa, user_id=7f00c627c6d440c1abc249e79cc43443, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:11.082431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:11.109464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1144/2310] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:18:11 2022] PUT /identity/v3/projects/15a699a9214845a58676d1e26e9871aa/users/7f00c627c6d440c1abc249e79cc43443/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:11.114437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:11.127678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233981-8011-42a4-a0bd-a48ee48c54ed admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:11.193072 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f0453-da51-4452-8a5f-3f9c9b7a76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:11.195012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f0453-da51-4452-8a5f-3f9c9b7a76a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.195291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f0453-da51-4452-8a5f-3f9c9b7a76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.195560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f0453-da51-4452-8a5f-3f9c9b7a76a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.196294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f0453-da51-4452-8a5f-3f9c9b7a76a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:11.198110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f0453-da51-4452-8a5f-3f9c9b7a76a1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:11.211250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1167/2311] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:18:11.215641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:11.243599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb080-bdd2-4763-a612-96a9cbf449e3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:11.250475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:11.251437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.251720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.252498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] PATH_INFO: `/v3/projects/15a699a9214845a58676d1e26e9871aa/users/7f00c627c6d440c1abc249e79cc43443/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.255528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a699a9214845a58676d1e26e9871aa, user_id=7f00c627c6d440c1abc249e79cc43443, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:11.258423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:11.272355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1145/2312] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:18:11 2022] PUT /identity/v3/projects/15a699a9214845a58676d1e26e9871aa/users/7f00c627c6d440c1abc249e79cc43443/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:11.282976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.283434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.284209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.330484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] MFA Rules not processed for user `7f00c627c6d440c1abc249e79cc43443`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:11.331928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:11.404557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1168/2313] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:11.418524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:11.420544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:11.490068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0222924-8659-4dcc-b729-cec1ec1ba2e6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:11.493694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f171-a2ac-40b8-81f0-5324ea1f8521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:11.494346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f171-a2ac-40b8-81f0-5324ea1f8521 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.494625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f171-a2ac-40b8-81f0-5324ea1f8521 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.494896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f171-a2ac-40b8-81f0-5324ea1f8521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.505399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f171-a2ac-40b8-81f0-5324ea1f8521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:11.506912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f171-a2ac-40b8-81f0-5324ea1f8521 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:11.521120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1146/2314] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:11.604027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:11.614363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1ac18-0f18-41ff-abe5-773d48f97ece None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:11.618539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:11.619195 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:11.619538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:11.619815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:11.686175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:11.687878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:11.698713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1169/2315] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:12.376214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829108-ac13-4e70-8fcb-97b26dfe5b44 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:12.376774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829108-ac13-4e70-8fcb-97b26dfe5b44 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:12.377401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e829108-ac13-4e70-8fcb-97b26dfe5b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:12.398124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5e829108-ac13-4e70-8fcb-97b26dfe5b44 None None] MFA Rules not processed for user `8b9373968e9c4eca8a038854815796ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:12.399361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5e829108-ac13-4e70-8fcb-97b26dfe5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:12.463645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1147/2316] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:18:55.704345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:55.767343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649dfee-5cbb-4ec8-90cc-2240826c480b service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:55.772761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:55.773659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:55.773940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:55.774202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] PATH_INFO: `/v3/users/b34e6f75cf71436db4be21cb8be13c33` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:55.775527 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34e6f75cf71436db4be21cb8be13c33)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:55.777542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:55.839894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34e6f75cf71436db4be21cb8be13c33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:55.847920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34e6f75cf71436db4be21cb8be13c33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:55.862377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34e6f75cf71436db4be21cb8be13c33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:55.871046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34e6f75cf71436db4be21cb8be13c33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:55.871642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34e6f75cf71436db4be21cb8be13c33'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:55.878167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1170/2317] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:18:55 2022] DELETE /identity/v3/users/b34e6f75cf71436db4be21cb8be13c33 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:55.883235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:55.883747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:55.883849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:55.901114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:55.902320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:55.963719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1148/2318] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:55.973791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:55.975494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:56.038366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d2c0-6d6e-4baa-8327-ea9ce954dc28 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:56.042448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:56.043094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:56.043380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:56.043651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:56.053015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:56.054434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:56.063639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1171/2319] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:56.346614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:56.348487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:56.361266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c42e-d59b-4064-9f03-83b847bbb867 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:56.367230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:56.368374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:56.368545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:56.368822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] PATH_INFO: `/v3/projects/08dff8feea734c44ac18138c5f7d993a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:56.370545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dff8feea734c44ac18138c5f7d993a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:56.377504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:56.425868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dff8feea734c44ac18138c5f7d993a', 'request_id': 'req-0398ef92-5d8d-4698-a931-4dbf8b837b7a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.434978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dff8feea734c44ac18138c5f7d993a', 'request_id': 'req-0398ef92-5d8d-4698-a931-4dbf8b837b7a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.441721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dff8feea734c44ac18138c5f7d993a', 'request_id': 'req-0398ef92-5d8d-4698-a931-4dbf8b837b7a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.452076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] The token cache is being invalidate because project 08dff8feea734c44ac18138c5f7d993a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:18:56.452361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.453032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.454598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1149/2320] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:18:56 2022] DELETE /identity/v3/projects/08dff8feea734c44ac18138c5f7d993a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:56.460765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:56.470940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef736779-4ef3-40da-b93a-2425f176d870 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:56.543484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:56.544365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:56.544645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:56.544929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] PATH_INFO: `/v3/users/7f00c627c6d440c1abc249e79cc43443` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:56.546202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f00c627c6d440c1abc249e79cc43443)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:56.548138 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:56.595598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f00c627c6d440c1abc249e79cc43443'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.602845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f00c627c6d440c1abc249e79cc43443'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.616004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f00c627c6d440c1abc249e79cc43443'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.625129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f00c627c6d440c1abc249e79cc43443'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.626127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a156d5c5-5061-4ddd-8032-789a36db6580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f00c627c6d440c1abc249e79cc43443'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:56.636436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1172/2321] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:18:56 2022] DELETE /identity/v3/users/7f00c627c6d440c1abc249e79cc43443 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:56.917885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:56.919455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:56.937121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398ef92-5d8d-4698-a931-4dbf8b837b7a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:56.996246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:56.997177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:56.997467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:56.997725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] PATH_INFO: `/v3/projects/15a699a9214845a58676d1e26e9871aa` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:56.998893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a699a9214845a58676d1e26e9871aa)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.000796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.047126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a699a9214845a58676d1e26e9871aa', 'request_id': 'req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:57.056413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a699a9214845a58676d1e26e9871aa', 'request_id': 'req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:57.065691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a699a9214845a58676d1e26e9871aa', 'request_id': 'req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:57.077957 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] The token cache is being invalidate because project 15a699a9214845a58676d1e26e9871aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:18:57.078259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:57.078985 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-87374bd0-5273-42a4-b7f7-b5a3bdcf9e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:18:57.080542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1150/2322] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:18:56 2022] DELETE /identity/v3/projects/15a699a9214845a58676d1e26e9871aa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:57.085549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.086067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.086168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.104436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:57.105685 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:57.171341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1173/2323] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:57.179412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.179696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.179965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.199848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:57.201075 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:57.210776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1151/2324] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:57.215172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.225389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2eb0f-f0c3-42e7-95ca-61881406cc80 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.231230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.232022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.232266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.232558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.233301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:18:57.233608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.235188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.247670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1174/2325] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:18:57.252084 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.262113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf41d-5399-44aa-9274-6501e091e5b3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.268090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.268734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.269038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.269308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.269997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.271911 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.303895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1152/2326] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:57.308270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.318466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43175a-f63a-4013-b5ae-2fc054210c93 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.374752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.375414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.375686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.375964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.376663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.378625 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.400551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1175/2327] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:18:57.404866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.415317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3d5c-faa9-4e9a-9d86-c0ca060ebbf1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.420235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.420889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.421216 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.421552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.422215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.423805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.434471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1153/2328] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:18:57.438349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.448927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d83b4e-0970-43d2-817c-d8e790960f98 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.454465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736da6b-da00-491c-80ce-f4ce58bb909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.455126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736da6b-da00-491c-80ce-f4ce58bb909b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.455402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736da6b-da00-491c-80ce-f4ce58bb909b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.455670 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736da6b-da00-491c-80ce-f4ce58bb909b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.456838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736da6b-da00-491c-80ce-f4ce58bb909b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.458675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736da6b-da00-491c-80ce-f4ce58bb909b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.468961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1176/2329] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:18:57.473156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.483140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadc36-37ff-40fd-8c22-527a8d19adb1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.488327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.489521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.489798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.490053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] PATH_INFO: `/v3/projects/1bb2fda5c84043dfadde0b4e395dce48/users/ab5529cc421a44f7bb0c22b18eb9f460/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.507204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb2fda5c84043dfadde0b4e395dce48, user_id=ab5529cc421a44f7bb0c22b18eb9f460, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.511376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.528359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1154/2330] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:18:57 2022] PUT /identity/v3/projects/1bb2fda5c84043dfadde0b4e395dce48/users/ab5529cc421a44f7bb0c22b18eb9f460/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:57.545766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.546075 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.546338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.574780 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] MFA Rules not processed for user `ab5529cc421a44f7bb0c22b18eb9f460`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:57.575989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:57.643565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1177/2331] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:18:57.648549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.711175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963e3bd-3e39-4076-9b9e-4a337dd0c6cd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.716224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.716872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.717180 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.717444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.718130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.720028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.749166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1155/2332] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:57.753444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.765184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc613-0778-495d-958d-3bbc467c9e28 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.836028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.836712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.837030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.837302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.838002 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.839959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.862201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1178/2333] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:18:57 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:18:57.866553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.877223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e1995-3cef-40ef-bad7-bbdbcfa33bbe admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.883689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.884356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.884631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.884936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.886840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.888425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.899931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1156/2334] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:18:57.905193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.922655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee28c9-fcfd-48f3-8ce2-373d386f68cd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:57.932417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:57.933879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:57.934320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:57.934758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] PATH_INFO: `/v3/projects/33eebdbddca747779b91a47e9a1889e8/users/5b799f0f696540778416ba72042b7abd/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:57.954119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33eebdbddca747779b91a47e9a1889e8, user_id=5b799f0f696540778416ba72042b7abd, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:57.956882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:57.972440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1179/2335] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:18:57 2022] PUT /identity/v3/projects/33eebdbddca747779b91a47e9a1889e8/users/5b799f0f696540778416ba72042b7abd/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:57.976763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:57.987166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4a174-4a2d-4bd4-944c-406b5bbe9a8c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:58.043429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6190-42bb-4d7f-ab4a-2a00bd0834e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:58.044090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6190-42bb-4d7f-ab4a-2a00bd0834e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:58.044363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6190-42bb-4d7f-ab4a-2a00bd0834e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:58.044637 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6190-42bb-4d7f-ab4a-2a00bd0834e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:58.045379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6190-42bb-4d7f-ab4a-2a00bd0834e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:58.046991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6190-42bb-4d7f-ab4a-2a00bd0834e3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:58.056852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1157/2336] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:18:58.061415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:58.071868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8cbef-532a-469c-b1ee-e3b51ee5d542 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:58.076837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:58.077736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:58.078009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:58.078311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] PATH_INFO: `/v3/projects/33eebdbddca747779b91a47e9a1889e8/users/5b799f0f696540778416ba72042b7abd/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:58.080246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33eebdbddca747779b91a47e9a1889e8, user_id=5b799f0f696540778416ba72042b7abd, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:58.082972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:58.098122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1180/2337] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:18:58 2022] PUT /identity/v3/projects/33eebdbddca747779b91a47e9a1889e8/users/5b799f0f696540778416ba72042b7abd/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:18:58.109754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:58.110227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:58.110685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:58.141276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] MFA Rules not processed for user `5b799f0f696540778416ba72042b7abd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:18:58.142495 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:58.214428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1158/2338] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:18:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:18:58.226633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:58.228708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:18:58.291739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318133-77dc-4695-9249-f50345bee314 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:58.296311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:58.296986 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:58.297241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:58.297513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:58.308914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:58.310347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:58.321233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1181/2339] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:18:58.401153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:18:58.410794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8123902-a20a-42ff-9996-2cf69cf44df9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:18:58.414981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2828-359d-493f-9e26-9f6f8d34895e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:18:58.415614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2828-359d-493f-9e26-9f6f8d34895e service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:18:58.415888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2828-359d-493f-9e26-9f6f8d34895e service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:18:58.416157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2828-359d-493f-9e26-9f6f8d34895e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:18:58.475279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2828-359d-493f-9e26-9f6f8d34895e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:18:58.477709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2828-359d-493f-9e26-9f6f8d34895e service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:18:58.493545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1159/2340] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:18:58 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:13.603344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:13.673064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c68c8c-f048-4fe4-9d7b-cc1b4809dc0a service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:13.678452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:13.679315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:13.679590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:13.679861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] PATH_INFO: `/v3/users/ab5529cc421a44f7bb0c22b18eb9f460` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:13.681093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5529cc421a44f7bb0c22b18eb9f460)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:13.683022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:13.733004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5529cc421a44f7bb0c22b18eb9f460'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:13.739927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5529cc421a44f7bb0c22b18eb9f460'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:13.754789 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5529cc421a44f7bb0c22b18eb9f460'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:13.765325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5529cc421a44f7bb0c22b18eb9f460'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:13.765965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5529cc421a44f7bb0c22b18eb9f460'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:13.773547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1182/2341] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:13 2022] DELETE /identity/v3/users/ab5529cc421a44f7bb0c22b18eb9f460 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:13.778382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:13.778881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:13.778881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:13.799923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:13.801864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:13.871946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1160/2342] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:13.882672 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:13.884329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:13.943025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526843e-5466-4d24-851b-08147eec20a5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:13.947506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:13.948168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:13.948441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:13.948707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:13.958497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:13.959925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:13.970069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1183/2343] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:14.244462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:14.246040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:14.260396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0e34-326d-43bc-8d28-e48a9d85a8d5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:14.266208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:14.267174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:14.267364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:14.267652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] PATH_INFO: `/v3/projects/1bb2fda5c84043dfadde0b4e395dce48` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:14.269207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb2fda5c84043dfadde0b4e395dce48)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:14.271152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:14.318451 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb2fda5c84043dfadde0b4e395dce48', 'request_id': 'req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.326762 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb2fda5c84043dfadde0b4e395dce48', 'request_id': 'req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.333360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb2fda5c84043dfadde0b4e395dce48', 'request_id': 'req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.343780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] The token cache is being invalidate because project 1bb2fda5c84043dfadde0b4e395dce48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:14.344059 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.344695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.346587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1161/2344] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:14 2022] DELETE /identity/v3/projects/1bb2fda5c84043dfadde0b4e395dce48 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:14.350868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:14.360730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267d31-11b0-4969-bde5-aa565038eed2 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:14.428936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:14.429845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:14.430155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:14.430425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] PATH_INFO: `/v3/users/5b799f0f696540778416ba72042b7abd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:14.431720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b799f0f696540778416ba72042b7abd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:14.433703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:14.497595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b799f0f696540778416ba72042b7abd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.505328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b799f0f696540778416ba72042b7abd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.516605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b799f0f696540778416ba72042b7abd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.524921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b799f0f696540778416ba72042b7abd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.525538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-57173188-c1d3-4e50-b537-5f537992bb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b799f0f696540778416ba72042b7abd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.531575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1184/2345] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:14 2022] DELETE /identity/v3/users/5b799f0f696540778416ba72042b7abd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:14.804023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:14.805240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:14.821181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0af2d-82a6-4ba8-8339-697076cf3cb7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:14.877455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:14.878254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:14.878529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:14.878796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] PATH_INFO: `/v3/projects/33eebdbddca747779b91a47e9a1889e8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:14.880343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33eebdbddca747779b91a47e9a1889e8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:14.882281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:14.931677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33eebdbddca747779b91a47e9a1889e8', 'request_id': 'req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.944644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33eebdbddca747779b91a47e9a1889e8', 'request_id': 'req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.951743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33eebdbddca747779b91a47e9a1889e8', 'request_id': 'req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.963454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] The token cache is being invalidate because project 33eebdbddca747779b91a47e9a1889e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:14.963741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.964387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-71fcfcd2-aa4e-4e55-909b-44a13aa1a502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:14.965973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1162/2346] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:14 2022] DELETE /identity/v3/projects/33eebdbddca747779b91a47e9a1889e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:19:14.971436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:14.971977 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:14.972080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:14.992866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:14.994098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:15.058739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1185/2347] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:15.069048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.069360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.069629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.088517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:15.089722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:15.099245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1163/2348] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:15.103807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.114082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5cab3-8215-4206-8802-d21369af0181 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.119902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.120551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.120826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.121143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.121871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:19:15.122174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.123786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.136812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1186/2349] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:19:15.141367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.151240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73764774-4b1d-49b8-8114-a8734526ced4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.157252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.157909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.158356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.158812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.159523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.161443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.190513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1164/2350] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:15 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:15.194850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.205030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53939c0-f37e-4119-8a80-470aafe67f2b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.267319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.267981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.268253 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.268532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.269243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.271139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.295880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1187/2351] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:15 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:19:15.302142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.316639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d73ef-647c-4ad9-9e87-fae45b4866f1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.322466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.323123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.323401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.323669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.324508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.326142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.336383 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1165/2352] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:19:15.340700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.353181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183023c3-d183-4802-85a1-5824ae592c00 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.358081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d88128-70d2-4fa9-b8a5-38edc9d345e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.358739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88128-70d2-4fa9-b8a5-38edc9d345e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.359040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88128-70d2-4fa9-b8a5-38edc9d345e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.359312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88128-70d2-4fa9-b8a5-38edc9d345e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.360034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d88128-70d2-4fa9-b8a5-38edc9d345e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.361940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d88128-70d2-4fa9-b8a5-38edc9d345e9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.372013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1188/2353] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:15.376337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.386784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86218e3-8479-4b3c-a7ec-d1d8bb319c4f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.391631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.392544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.392748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.393048 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] PATH_INFO: `/v3/projects/d3995e7c5b6b4ca0bfa8610c90e34db2/users/7284dec0ed4945e49bf78ffd0ae86a14/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.407703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3995e7c5b6b4ca0bfa8610c90e34db2, user_id=7284dec0ed4945e49bf78ffd0ae86a14, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.410516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.426982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1166/2354] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:15 2022] PUT /identity/v3/projects/d3995e7c5b6b4ca0bfa8610c90e34db2/users/7284dec0ed4945e49bf78ffd0ae86a14/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:15.438119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.438440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.438749 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.466004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] MFA Rules not processed for user `7284dec0ed4945e49bf78ffd0ae86a14`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:15.467239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:15.540006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1189/2355] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:15.544864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.610791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05f60-5f3e-4460-b3ae-adeb2ee73035 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.617027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.617979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.618335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.618686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.619713 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.622769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.658318 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1167/2356] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:15 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:15.662537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.673372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aed330-812e-460b-a843-5af6fb9eac89 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.735819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.736712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.736852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.737186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.737898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.739832 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.761502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1190/2357] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:15 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:15.765590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.776202 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d44e0-7d65-4ea4-af03-de93104fa2bb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.781358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.782012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.782290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.782559 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.783550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.785286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.795733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1168/2358] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:15.800247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.811358 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612fe8b-96fb-45f7-8d7d-ef948a8877ac admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.817320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.818249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.818511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.818776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] PATH_INFO: `/v3/projects/13dcf4f7885a4ed6bd8ce2af21d09d9e/users/a1ccc3fe6e324888b65b68ff44aec794/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.835247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dcf4f7885a4ed6bd8ce2af21d09d9e, user_id=a1ccc3fe6e324888b65b68ff44aec794, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.838051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.853417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1191/2359] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:15 2022] PUT /identity/v3/projects/13dcf4f7885a4ed6bd8ce2af21d09d9e/users/a1ccc3fe6e324888b65b68ff44aec794/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:15.862695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.873343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2836-f3ff-4b33-a06b-7d0cfa58ff19 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.933540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a2ccb-3e83-4cbe-b243-49273d2c5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.934127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a2ccb-3e83-4cbe-b243-49273d2c5766 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.934404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a2ccb-3e83-4cbe-b243-49273d2c5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.934671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a2ccb-3e83-4cbe-b243-49273d2c5766 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.935390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a2ccb-3e83-4cbe-b243-49273d2c5766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.937029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a2ccb-3e83-4cbe-b243-49273d2c5766 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.946849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1169/2360] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:15.951331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:15.961989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912522-0b41-43d4-8722-cad8d853891b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:15.966912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:15.967795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:15.968077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:15.968340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] PATH_INFO: `/v3/projects/13dcf4f7885a4ed6bd8ce2af21d09d9e/users/a1ccc3fe6e324888b65b68ff44aec794/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:15.970403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dcf4f7885a4ed6bd8ce2af21d09d9e, user_id=a1ccc3fe6e324888b65b68ff44aec794, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:15.975307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:15.992731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1192/2361] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:15 2022] PUT /identity/v3/projects/13dcf4f7885a4ed6bd8ce2af21d09d9e/users/a1ccc3fe6e324888b65b68ff44aec794/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:19:16.007023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:16.007310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:16.007586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:16.035819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] MFA Rules not processed for user `a1ccc3fe6e324888b65b68ff44aec794`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:16.037085 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:16.107745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1170/2362] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:16.121527 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:16.123896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:16.184426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad8f8a-bafd-4dcb-abc6-1746db13e4f2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:16.191007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:16.191925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:16.192275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:16.192605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:16.207047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:16.208487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:16.218217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1193/2363] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:16.298190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:16.308815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ea227-4352-4dff-a947-8c151fed5064 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:16.312402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb73a3-6e19-4b71-80f0-a7a483e762fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:16.313079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb73a3-6e19-4b71-80f0-a7a483e762fa service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:16.313378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb73a3-6e19-4b71-80f0-a7a483e762fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:16.313627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb73a3-6e19-4b71-80f0-a7a483e762fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:16.373001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb73a3-6e19-4b71-80f0-a7a483e762fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:16.374447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb73a3-6e19-4b71-80f0-a7a483e762fa service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:16.384088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1171/2364] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:27.766411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:27.829026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3d3e-206f-4453-a154-bdb73c60069a service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:27.833843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:27.835131 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:27.835406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:27.835680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] PATH_INFO: `/v3/users/7284dec0ed4945e49bf78ffd0ae86a14` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:27.836861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7284dec0ed4945e49bf78ffd0ae86a14)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:27.838806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:27.888839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7284dec0ed4945e49bf78ffd0ae86a14'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:27.895342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7284dec0ed4945e49bf78ffd0ae86a14'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:27.906673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7284dec0ed4945e49bf78ffd0ae86a14'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:27.916726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7284dec0ed4945e49bf78ffd0ae86a14'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:27.917383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7284dec0ed4945e49bf78ffd0ae86a14'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:27.926034 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1194/2365] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:27 2022] DELETE /identity/v3/users/7284dec0ed4945e49bf78ffd0ae86a14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:27.931035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:27.931524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:27.931633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:27.948929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:27.950131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:28.012590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1172/2366] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:28.022876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:28.024725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:28.090448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260b36c-a706-4d21-80c5-db23978bb8b8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:28.095241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:28.095892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:28.096167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:28.096437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:28.107447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:28.108891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:28.119170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1195/2367] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:28.403520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:28.405047 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:28.417981 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ea594-03e1-4e2f-8326-5c8edfe4e354 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:28.423287 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:28.424162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:28.424436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:28.424717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] PATH_INFO: `/v3/projects/d3995e7c5b6b4ca0bfa8610c90e34db2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:28.426805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3995e7c5b6b4ca0bfa8610c90e34db2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:28.428821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:28.477970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3995e7c5b6b4ca0bfa8610c90e34db2', 'request_id': 'req-04064f51-a198-4318-9d77-c873e178665e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.487530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3995e7c5b6b4ca0bfa8610c90e34db2', 'request_id': 'req-04064f51-a198-4318-9d77-c873e178665e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.493909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3995e7c5b6b4ca0bfa8610c90e34db2', 'request_id': 'req-04064f51-a198-4318-9d77-c873e178665e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.504548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] The token cache is being invalidate because project d3995e7c5b6b4ca0bfa8610c90e34db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:28.505375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.506050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.508029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1173/2368] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:28 2022] DELETE /identity/v3/projects/d3995e7c5b6b4ca0bfa8610c90e34db2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:28.512143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:28.521700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6938d6-fa25-4720-a57d-adc9a731e088 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:28.581611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:28.582487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:28.582761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:28.583029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] PATH_INFO: `/v3/users/a1ccc3fe6e324888b65b68ff44aec794` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:28.584507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ccc3fe6e324888b65b68ff44aec794)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:28.586647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:28.640012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ccc3fe6e324888b65b68ff44aec794'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.647227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ccc3fe6e324888b65b68ff44aec794'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.660721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ccc3fe6e324888b65b68ff44aec794'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.670771 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ccc3fe6e324888b65b68ff44aec794'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.671469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f9cc2357-8f43-472c-8fa2-f68765bd3637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ccc3fe6e324888b65b68ff44aec794'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:28.677653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1196/2369] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:28 2022] DELETE /identity/v3/users/a1ccc3fe6e324888b65b68ff44aec794 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:28.961988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:28.963700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:28.984416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04064f51-a198-4318-9d77-c873e178665e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.044209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.045042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.045321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.045592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] PATH_INFO: `/v3/projects/13dcf4f7885a4ed6bd8ce2af21d09d9e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.046865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13dcf4f7885a4ed6bd8ce2af21d09d9e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.048849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.097947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13dcf4f7885a4ed6bd8ce2af21d09d9e', 'request_id': 'req-c7afd32a-af55-40e0-83b8-27e8296babc9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:29.109126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13dcf4f7885a4ed6bd8ce2af21d09d9e', 'request_id': 'req-c7afd32a-af55-40e0-83b8-27e8296babc9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:29.117942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13dcf4f7885a4ed6bd8ce2af21d09d9e', 'request_id': 'req-c7afd32a-af55-40e0-83b8-27e8296babc9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:29.130229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] The token cache is being invalidate because project 13dcf4f7885a4ed6bd8ce2af21d09d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:29.130517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:29.131272 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c7afd32a-af55-40e0-83b8-27e8296babc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:29.132997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1174/2370] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:28 2022] DELETE /identity/v3/projects/13dcf4f7885a4ed6bd8ce2af21d09d9e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:29.139635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.140164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.140164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.161419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:29.162641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:29.223912 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1197/2371] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:29.233565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.233855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.234158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.253844 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:29.255436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:29.265138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1175/2372] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:29.269945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.284066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f55c75-fa43-4b33-950d-57402f00abdf None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.290136 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.290881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.291200 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.291493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.292339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:19:29.292644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.294363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.305703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1198/2373] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:19:29.310149 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.319850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeec44c-a1ba-472a-a9ce-f352f802f251 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.325179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.325831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.326109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.326381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.327066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.328992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.358256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1176/2374] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:29 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:29.362491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.372943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a5729-eeba-4956-8698-2926f6e52eaa admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.430530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.431203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.431511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.431783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.432505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.434455 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.455019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1199/2375] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:29 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:29.460441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.478058 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5d9d-4f0b-46cf-8cc3-ccac90a872fb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.483732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.484682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.484999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.485271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.486004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.487629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.498741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1177/2376] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:29.502967 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.513833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40933ba9-8d9d-49ec-8d1a-14a9a8b00b17 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.520772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ccd7e-886f-4ff9-b00f-71f26b73d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.521807 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ccd7e-886f-4ff9-b00f-71f26b73d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.522183 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ccd7e-886f-4ff9-b00f-71f26b73d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.522451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ccd7e-886f-4ff9-b00f-71f26b73d9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.523516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ccd7e-886f-4ff9-b00f-71f26b73d9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.526132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ccd7e-886f-4ff9-b00f-71f26b73d9fe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.537270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1200/2377] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:29.541728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.551861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca823042-6dc8-43eb-a1df-73cdfb327cdf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.556654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.557576 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.557848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.558115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] PATH_INFO: `/v3/projects/f3a08c14d5934649a9e7778ae127bad5/users/66c721285585446d8371a1d678c0a31e/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.572784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a08c14d5934649a9e7778ae127bad5, user_id=66c721285585446d8371a1d678c0a31e, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.575460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.590518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1178/2378] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:29 2022] PUT /identity/v3/projects/f3a08c14d5934649a9e7778ae127bad5/users/66c721285585446d8371a1d678c0a31e/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:29.597907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c54f03-8eb8-41be-aaf1-bd1e01bb9c7c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.598239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c54f03-8eb8-41be-aaf1-bd1e01bb9c7c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.598515 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c54f03-8eb8-41be-aaf1-bd1e01bb9c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.618202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-17c54f03-8eb8-41be-aaf1-bd1e01bb9c7c None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:29.619407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-17c54f03-8eb8-41be-aaf1-bd1e01bb9c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:29.693222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1201/2379] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:29.705847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:29.707848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:29.764984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f14a8-85ba-4230-8eb7-2f599ccdd9bb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:29.768833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:29.769508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:29.769795 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:29.770065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:29.779842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:29.780730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:29.790136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1179/2380] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:30.423608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.424148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.424382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.451669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] MFA Rules not processed for user `66c721285585446d8371a1d678c0a31e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:30.452913 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:30.517853 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1202/2381] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:30.522829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:30.532984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ef048-dcb7-4266-97b5-8b397c917d2c service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:30.538182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:30.538846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.539239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.540074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.540778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:30.543041 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:30.573475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1180/2382] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:30 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:30.574972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:30.586512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fa533-a93a-464f-9c24-c6e2038dd439 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:30.645015 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:30.645788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.646100 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.646452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.647388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:30.649704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:30.669410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1203/2383] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:30 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:30.673523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:30.684191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c942f-0672-46d7-9ed9-df25ceb19ea8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:30.688856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:30.689595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.689871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.690141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.690869 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:30.692479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:30.704404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1181/2384] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:30.709001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:30.719678 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc2b42-877a-4a40-ba37-bf4fe9582ece admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:30.725605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:30.726489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.726761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.727031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] PATH_INFO: `/v3/projects/c105670ff4f34959be787ac936b8d44e/users/fe342b2cf17d4aba8b3e384752d16b40/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.742911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c105670ff4f34959be787ac936b8d44e, user_id=fe342b2cf17d4aba8b3e384752d16b40, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:30.745582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:30.762343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1204/2385] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:30 2022] PUT /identity/v3/projects/c105670ff4f34959be787ac936b8d44e/users/fe342b2cf17d4aba8b3e384752d16b40/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:30.767786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:30.779908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acfa00-2875-44e9-aee7-8fed5b7c57fd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:30.847522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30a2a0-7edb-46fc-9f92-226d3e4e7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:30.848198 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30a2a0-7edb-46fc-9f92-226d3e4e7c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.848479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30a2a0-7edb-46fc-9f92-226d3e4e7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.848748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30a2a0-7edb-46fc-9f92-226d3e4e7c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.849504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30a2a0-7edb-46fc-9f92-226d3e4e7c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:30.851260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30a2a0-7edb-46fc-9f92-226d3e4e7c42 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:30.861257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1182/2386] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:30.865561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:30.876616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669652d-8e22-4dad-bc22-e175813c7714 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:30.883080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:30.883972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:30.884251 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:30.884520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] PATH_INFO: `/v3/projects/c105670ff4f34959be787ac936b8d44e/users/fe342b2cf17d4aba8b3e384752d16b40/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:30.886874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c105670ff4f34959be787ac936b8d44e, user_id=fe342b2cf17d4aba8b3e384752d16b40, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:30.889554 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:30.901102 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1205/2387] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:30 2022] PUT /identity/v3/projects/c105670ff4f34959be787ac936b8d44e/users/fe342b2cf17d4aba8b3e384752d16b40/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:31.630994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:31.631581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:31.631581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:31.659167 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] MFA Rules not processed for user `fe342b2cf17d4aba8b3e384752d16b40`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:31.660505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:31.730471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1183/2388] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:31.744043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:31.745969 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:31.803660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90669-d420-47bd-92c9-6aab53a30705 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:31.807919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421c33-7f8d-4ce1-8e65-06455c15c94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:31.808587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421c33-7f8d-4ce1-8e65-06455c15c94f service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:31.808870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421c33-7f8d-4ce1-8e65-06455c15c94f service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:31.809167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421c33-7f8d-4ce1-8e65-06455c15c94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:31.870311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421c33-7f8d-4ce1-8e65-06455c15c94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:31.871847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421c33-7f8d-4ce1-8e65-06455c15c94f service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:31.881428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1206/2389] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:33.240334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:33.242529 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:33.261970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4514f-b84c-4f48-be81-50a492aba7e5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:33.266945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:33.267585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:33.267861 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:33.268130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:33.278286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:33.279760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:33.289622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1184/2390] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:41.481330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:41.481829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:41.481829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:41.500736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:41.502001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:41.559661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1207/2391] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:19:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:41.607679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:41.609265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:41.692224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58076-47b8-4b34-a0b1-d28154b780e3 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:41.698236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:41.698892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:41.699227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:41.699509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:41.709955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:41.711639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:41.719803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1185/2392] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:19:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:19:47.545230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:47.612597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389427-5039-4b6c-bfc7-2d764e2f988f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:47.617491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:47.618359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:47.618657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:47.618945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] PATH_INFO: `/v3/users/66c721285585446d8371a1d678c0a31e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:47.620250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c721285585446d8371a1d678c0a31e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:47.622281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:47.672137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c721285585446d8371a1d678c0a31e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:47.679693 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c721285585446d8371a1d678c0a31e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:47.691454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c721285585446d8371a1d678c0a31e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:47.700247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c721285585446d8371a1d678c0a31e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:47.700710 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c721285585446d8371a1d678c0a31e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:47.706971 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1208/2393] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:47 2022] DELETE /identity/v3/users/66c721285585446d8371a1d678c0a31e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:47.883518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:47.900724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5dc6e-23bf-4463-bfc7-c2a92499c1c5 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:47.959920 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:47.960792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:47.961114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:47.961372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] PATH_INFO: `/v3/projects/f3a08c14d5934649a9e7778ae127bad5` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:47.962604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a08c14d5934649a9e7778ae127bad5)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:47.964557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:48.015673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a08c14d5934649a9e7778ae127bad5', 'request_id': 'req-28f2a58e-64ce-4f45-88bb-85d6934ced5d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.025106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a08c14d5934649a9e7778ae127bad5', 'request_id': 'req-28f2a58e-64ce-4f45-88bb-85d6934ced5d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.035120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a08c14d5934649a9e7778ae127bad5', 'request_id': 'req-28f2a58e-64ce-4f45-88bb-85d6934ced5d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.045161 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] The token cache is being invalidate because project f3a08c14d5934649a9e7778ae127bad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:48.045458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.046304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.051401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1186/2394] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:47 2022] DELETE /identity/v3/projects/f3a08c14d5934649a9e7778ae127bad5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:48.052615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:48.054150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:48.068452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a3941-3992-4454-8967-573df64065b1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:48.129994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:48.131121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:48.131472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:48.131753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] PATH_INFO: `/v3/users/fe342b2cf17d4aba8b3e384752d16b40` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:48.133006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe342b2cf17d4aba8b3e384752d16b40)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:48.134938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:48.181938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe342b2cf17d4aba8b3e384752d16b40'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.188618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe342b2cf17d4aba8b3e384752d16b40'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.202221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe342b2cf17d4aba8b3e384752d16b40'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.228355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe342b2cf17d4aba8b3e384752d16b40'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.229116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eaac9e37-62eb-4f98-884e-b46758e33220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe342b2cf17d4aba8b3e384752d16b40'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.239255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1209/2395] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:48 2022] DELETE /identity/v3/users/fe342b2cf17d4aba8b3e384752d16b40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:19:48.541189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:48.542724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:48.567210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2a58e-64ce-4f45-88bb-85d6934ced5d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:48.641678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:48.642926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:48.643708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:48.644089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] PATH_INFO: `/v3/projects/c105670ff4f34959be787ac936b8d44e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:48.646053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c105670ff4f34959be787ac936b8d44e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:48.649023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:48.707841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c105670ff4f34959be787ac936b8d44e', 'request_id': 'req-cd588edd-85c8-4b94-b80b-28470c775d72'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.717337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c105670ff4f34959be787ac936b8d44e', 'request_id': 'req-cd588edd-85c8-4b94-b80b-28470c775d72'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.725801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c105670ff4f34959be787ac936b8d44e', 'request_id': 'req-cd588edd-85c8-4b94-b80b-28470c775d72'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.737901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] The token cache is being invalidate because project c105670ff4f34959be787ac936b8d44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:48.738195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.738982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd588edd-85c8-4b94-b80b-28470c775d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:48.740685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1187/2396] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:48 2022] DELETE /identity/v3/projects/c105670ff4f34959be787ac936b8d44e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:48.746300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:48.746871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:48.746871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:48.768147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:48.773641 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:48.858406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1210/2397] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:19:48.867597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:48.868156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:48.868504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:48.889991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:48.891204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:48.900024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1188/2398] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:48.904569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:48.914592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f47b13-ca9b-4b30-a711-d8fc3299cc16 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:48.919301 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:48.919956 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:48.920226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:48.920476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:48.921469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:19:48.921768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:48.923367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:48.939878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1211/2399] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:19:48.941354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:48.953127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05bb2-5111-4176-a8a3-26a9cd0da0d7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:48.957749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:48.958735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:48.959286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:48.959700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:48.960690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:48.962724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:48.997715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1189/2400] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:48 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:19:48.999204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.011508 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e27862-8c30-42e1-80e7-520c500c840f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.072290 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.072995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.073277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.073556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.074272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.076182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.100811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1212/2401] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:48 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:19:49.105531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.118130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303954f6-f8af-47db-a464-5ce195f8957c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.123037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.123774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.124244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.124735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.125965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.127309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.139390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1190/2402] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:49.143955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.156982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5df28-6f5f-4fb3-9de6-f14aeaa9210c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.163907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937639f-f270-4be3-bc34-81188d5ad300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.164657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937639f-f270-4be3-bc34-81188d5ad300 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.165051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937639f-f270-4be3-bc34-81188d5ad300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.165389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937639f-f270-4be3-bc34-81188d5ad300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.166223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937639f-f270-4be3-bc34-81188d5ad300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.167881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937639f-f270-4be3-bc34-81188d5ad300 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.183311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1213/2403] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:49.185598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.196970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa874581-c1e3-40e2-aa5b-8f16044ff738 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.201801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.202697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.202970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.203238 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] PATH_INFO: `/v3/projects/a3f80d6cfb5d4a3e8bffd0cf28c99dc2/users/d8dfefcf96b44a8b8ca42b495293f248/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.218989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f80d6cfb5d4a3e8bffd0cf28c99dc2, user_id=d8dfefcf96b44a8b8ca42b495293f248, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.221875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.240070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1191/2404] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:49 2022] PUT /identity/v3/projects/a3f80d6cfb5d4a3e8bffd0cf28c99dc2/users/d8dfefcf96b44a8b8ca42b495293f248/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:49.251519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.251870 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.252159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.289814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] MFA Rules not processed for user `d8dfefcf96b44a8b8ca42b495293f248`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:49.291092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:49.370045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1214/2405] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:49.383255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.385781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:49.457304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08462f72-1e54-472a-aa85-7000d76617fc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.461964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffb1f-5b64-4cd0-b9d7-46aa7bbf8844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.462627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffb1f-5b64-4cd0-b9d7-46aa7bbf8844 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.462927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffb1f-5b64-4cd0-b9d7-46aa7bbf8844 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.463197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffb1f-5b64-4cd0-b9d7-46aa7bbf8844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.476643 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffb1f-5b64-4cd0-b9d7-46aa7bbf8844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.481057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffb1f-5b64-4cd0-b9d7-46aa7bbf8844 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.496956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1192/2406] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:49.516945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.594464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b41e24-28fc-47ec-9297-d02803934a07 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.603850 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.605411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.605687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.606391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] PATH_INFO: `/v3/users/d8dfefcf96b44a8b8ca42b495293f248` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.607219 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dfefcf96b44a8b8ca42b495293f248)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.609181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.672105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dfefcf96b44a8b8ca42b495293f248'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:49.680289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dfefcf96b44a8b8ca42b495293f248'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:49.693310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dfefcf96b44a8b8ca42b495293f248'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:49.704762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dfefcf96b44a8b8ca42b495293f248'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:49.706531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dfefcf96b44a8b8ca42b495293f248'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:49.713509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1215/2407] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:49 2022] DELETE /identity/v3/users/d8dfefcf96b44a8b8ca42b495293f248 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:49.717925 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.718329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.718706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.738069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:49.738995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:49.802728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1193/2408] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:49.813040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:49.814482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:49.875976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e46cd1-7d3e-4685-b9d9-2e17fc168aab admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:49.880573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bfe2d-4dc2-4bc8-bb2c-0f7c7af92e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:49.881285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfe2d-4dc2-4bc8-bb2c-0f7c7af92e72 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:49.881665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfe2d-4dc2-4bc8-bb2c-0f7c7af92e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:49.881954 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfe2d-4dc2-4bc8-bb2c-0f7c7af92e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:49.893498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bfe2d-4dc2-4bc8-bb2c-0f7c7af92e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:49.895037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bfe2d-4dc2-4bc8-bb2c-0f7c7af92e72 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:49.905524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1216/2409] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:50.209669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.211224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:50.231568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41b264-0964-4a64-b3d1-238c6321df19 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.237858 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.238766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.239043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.239312 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] PATH_INFO: `/v3/projects/a3f80d6cfb5d4a3e8bffd0cf28c99dc2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.240967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f80d6cfb5d4a3e8bffd0cf28c99dc2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.242542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.304573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f80d6cfb5d4a3e8bffd0cf28c99dc2', 'request_id': 'req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:50.312289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f80d6cfb5d4a3e8bffd0cf28c99dc2', 'request_id': 'req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:50.319792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f80d6cfb5d4a3e8bffd0cf28c99dc2', 'request_id': 'req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:50.333106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] The token cache is being invalidate because project a3f80d6cfb5d4a3e8bffd0cf28c99dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:50.333533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:50.334306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b4047e23-6170-4c1a-9cb5-e43b4e27f3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:50.339323 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1194/2410] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:50 2022] DELETE /identity/v3/projects/a3f80d6cfb5d4a3e8bffd0cf28c99dc2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:50.342194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.342533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.342806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.366412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:50.368127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:50.448934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1217/2411] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:50.527301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.527779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.528116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.547770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:50.549251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:50.558401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1195/2412] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:50.562352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.576719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09d002-3a3a-41a8-b4c8-aac80de6ec62 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.581815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.582483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.582759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.583029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.583763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:19:50.584067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.585752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.603754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1218/2413] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:19:50.605431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.615738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868624d1-3a64-4cdf-b58b-af0cc313c3d0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.620851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.621778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.622159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.622534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.623355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.625588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.654940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1196/2414] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:50 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:50.659936 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.670987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01678b14-3996-4b7d-a21c-d6d8bf89700b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.733539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.734228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.734504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.734772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.735469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.737447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.764070 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1219/2415] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:50 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:50.768520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.782739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ff7f4-a9ef-4d3d-927c-edc64dfb7801 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.788342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.789071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.789345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.789618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.790356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.791962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.810425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1197/2416] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:50.811532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.824065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c32cab-d4f1-4c8c-9fbd-de48b1726333 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.833587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b6186-0341-4461-976a-24c59f62416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.834277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b6186-0341-4461-976a-24c59f62416f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.834558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b6186-0341-4461-976a-24c59f62416f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.834828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b6186-0341-4461-976a-24c59f62416f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.835567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b6186-0341-4461-976a-24c59f62416f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.837205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b6186-0341-4461-976a-24c59f62416f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.858009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1220/2417] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:50.862672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:50.876998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dec65-4b83-4d18-bdf5-2eaaf4f17f5c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:50.890061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:50.890983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.891263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.891537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] PATH_INFO: `/v3/projects/b04670124de348f984ae4a1526a35bfe/users/0fe0150ebb184f5789e0c403e141b022/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.919466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04670124de348f984ae4a1526a35bfe, user_id=0fe0150ebb184f5789e0c403e141b022, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:50.934749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:50.943195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1198/2418] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:50 2022] PUT /identity/v3/projects/b04670124de348f984ae4a1526a35bfe/users/0fe0150ebb184f5789e0c403e141b022/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:50.953394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:50.953859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:50.954128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:50.985248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] MFA Rules not processed for user `0fe0150ebb184f5789e0c403e141b022`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:50.987262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:51.057635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1221/2419] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:19:51.091788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:51.093599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:51.159902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb637ea-8d5b-4c3a-b20a-9591ace6c80e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:51.164009 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af35b-a2fc-4d3f-8ec0-f2c8877db9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:51.164749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af35b-a2fc-4d3f-8ec0-f2c8877db9cf service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:51.165143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af35b-a2fc-4d3f-8ec0-f2c8877db9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:51.165479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af35b-a2fc-4d3f-8ec0-f2c8877db9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:51.174553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af35b-a2fc-4d3f-8ec0-f2c8877db9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:51.176148 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af35b-a2fc-4d3f-8ec0-f2c8877db9cf service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:51.187357 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1199/2420] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:51.202212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:51.279093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22b87e-81ab-4bbd-af4e-93ba40f3a524 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:51.287351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:51.288346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:51.291701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:51.291701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] PATH_INFO: `/v3/users/0fe0150ebb184f5789e0c403e141b022` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:51.292615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe0150ebb184f5789e0c403e141b022)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:51.294765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:51.354081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe0150ebb184f5789e0c403e141b022'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:51.362233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe0150ebb184f5789e0c403e141b022'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:51.376259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe0150ebb184f5789e0c403e141b022'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:51.386748 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe0150ebb184f5789e0c403e141b022'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:51.387373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe0150ebb184f5789e0c403e141b022'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:51.399511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1222/2421] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:19:51 2022] DELETE /identity/v3/users/0fe0150ebb184f5789e0c403e141b022 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:51.404382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:51.404990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:51.404990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:51.424362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:51.426020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:51.519908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1200/2422] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:51.530069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:51.531361 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:51.594391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ed566-1266-4001-a4bd-a4fe5ef6a757 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:51.598774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b09188-ef53-4884-b2f0-5fed2b43c327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:51.599511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b09188-ef53-4884-b2f0-5fed2b43c327 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:51.599861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b09188-ef53-4884-b2f0-5fed2b43c327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:51.600180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b09188-ef53-4884-b2f0-5fed2b43c327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:51.616751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b09188-ef53-4884-b2f0-5fed2b43c327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:51.618340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b09188-ef53-4884-b2f0-5fed2b43c327 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:51.631060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1223/2423] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:51.918548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:51.919983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:51.953665 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7176f7c-161c-460c-adc2-18bb6ab7516e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:51.970577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:51.971808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:51.972231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:51.972478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] PATH_INFO: `/v3/projects/b04670124de348f984ae4a1526a35bfe` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:51.977831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04670124de348f984ae4a1526a35bfe)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:51.979988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.039205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04670124de348f984ae4a1526a35bfe', 'request_id': 'req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:52.050345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04670124de348f984ae4a1526a35bfe', 'request_id': 'req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:52.059733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04670124de348f984ae4a1526a35bfe', 'request_id': 'req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:52.081176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] The token cache is being invalidate because project b04670124de348f984ae4a1526a35bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:19:52.081829 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:52.082698 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9e118483-4c9c-4a6d-9c1d-ef1a70ef6d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:19:52.084780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1201/2424] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:19:51 2022] DELETE /identity/v3/projects/b04670124de348f984ae4a1526a35bfe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:19:52.089724 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.090607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.091114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.111841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:52.113619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:52.212505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1224/2425] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:19:52.220566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.220859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.221273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.241409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:52.242718 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:52.252519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1202/2426] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:19:52.257197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.266644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078ba9-f4ca-4db0-9764-04a5aeb71761 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.271541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.272203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.272480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.272754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.273562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:19:52.273857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.275458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.290990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1225/2427] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:19:52.292239 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.301798 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8e86-6996-4dd7-8e27-48a2aec3683f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.307134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.307791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.308066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.308354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.309083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.310980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.339746 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1203/2428] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:19:52 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:52.344824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.355497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b909f76-5fb0-49d3-ae47-8e066df35d68 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.410390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.411062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.411340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.411607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.412297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.414274 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.436096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1226/2429] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:19:52 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:19:52.440707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.451914 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977329-069d-4ac5-bc7a-d34547a15537 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.457157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.457898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.458118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.458393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.459126 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.460780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.471436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1204/2430] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:52.475842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.485914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1a022-03d1-4b4b-814a-02576a1bf1f3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.491365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27e573-16b9-4ae6-bdb0-c61a86ad855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.492019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e573-16b9-4ae6-bdb0-c61a86ad855a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.492295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e573-16b9-4ae6-bdb0-c61a86ad855a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.492564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e573-16b9-4ae6-bdb0-c61a86ad855a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.493333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27e573-16b9-4ae6-bdb0-c61a86ad855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.494917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27e573-16b9-4ae6-bdb0-c61a86ad855a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.504828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1227/2431] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:19:52.509551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.519822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1f3dc-e776-4f09-89e8-217ee4f9fe47 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.524626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.525517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.525796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.526052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] PATH_INFO: `/v3/projects/ecc1c89a883445b49c2935b6908cc949/users/a18be5d8d3df414b8c9bb1c03cead049/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.541223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1c89a883445b49c2935b6908cc949, user_id=a18be5d8d3df414b8c9bb1c03cead049, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.543865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.558825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1205/2432] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:19:52 2022] PUT /identity/v3/projects/ecc1c89a883445b49c2935b6908cc949/users/a18be5d8d3df414b8c9bb1c03cead049/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:19:52.571236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07685e-c784-4be7-9930-a5564f5cc7ad None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.571524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07685e-c784-4be7-9930-a5564f5cc7ad None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.571785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07685e-c784-4be7-9930-a5564f5cc7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.604763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ec07685e-c784-4be7-9930-a5564f5cc7ad None None] MFA Rules not processed for user `a18be5d8d3df414b8c9bb1c03cead049`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:52.606980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ec07685e-c784-4be7-9930-a5564f5cc7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:52.685576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1228/2433] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:19:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:19:52.697370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:19:52.700039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:52.780222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28968-2535-4157-8f95-6ba1aaab2620 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:19:52.785522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:19:52.786159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:52.786441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:52.786712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:52.796932 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:19:52.798435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:19:52.813736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1206/2434] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:19:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:19:59.916586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:19:59.917099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:19:59.917203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:19:59.935985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:19:59.937234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:19:59.995525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1229/2435] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:19:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:00.008509 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:00.010165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:00.084004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aa5d9-e586-481b-a9f5-bbb259a5f6c9 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:00.091137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:00.091785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:00.092073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:00.092341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:00.101498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:00.103098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:00.111505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1207/2436] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:20:01.849170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:01.850939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:01.909738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788d78c-374c-4451-86b4-ce9ba5ce8790 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:01.913351 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:01.914000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:01.914297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:01.914549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:01.916314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:01.997214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:01.998688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819d74c-7c8e-41ac-9992-3ae0c92e1825 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:02.010263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1230/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:03.142083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:03.211205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9bb0-b04e-4c3d-8bf7-a6ce116651c6 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:03.215990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:03.216590 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:03.217069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:03.217361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] PATH_INFO: `/v3/users/a18be5d8d3df414b8c9bb1c03cead049` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:03.218584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18be5d8d3df414b8c9bb1c03cead049)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:03.220513 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:03.284654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18be5d8d3df414b8c9bb1c03cead049'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.294524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18be5d8d3df414b8c9bb1c03cead049'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.322204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18be5d8d3df414b8c9bb1c03cead049'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.323664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18be5d8d3df414b8c9bb1c03cead049'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.324298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18be5d8d3df414b8c9bb1c03cead049'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.369454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1208/2438] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:20:03 2022] DELETE /identity/v3/users/a18be5d8d3df414b8c9bb1c03cead049 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:03.371695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:03.372150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:03.372250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:03.408567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:03.410062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:03.475606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1231/2439] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:20:03.486369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:03.488023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:03.552821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54573a21-1f52-472d-9dd0-77ccabaede95 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:03.556734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:03.557410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:03.557684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:03.557949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:03.567617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:03.569219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:03.580136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1209/2440] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:03.873006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:03.874440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:03.886792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f589-b507-42c9-b88d-aefd73d46d48 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:03.891349 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:03.893053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:03.893337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:03.893921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] PATH_INFO: `/v3/projects/ecc1c89a883445b49c2935b6908cc949` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:03.895123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc1c89a883445b49c2935b6908cc949)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:03.897941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:03.951810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc1c89a883445b49c2935b6908cc949', 'request_id': 'req-030094b0-2253-416c-9e42-a512dc730fa7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.960944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc1c89a883445b49c2935b6908cc949', 'request_id': 'req-030094b0-2253-416c-9e42-a512dc730fa7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.967061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc1c89a883445b49c2935b6908cc949', 'request_id': 'req-030094b0-2253-416c-9e42-a512dc730fa7'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.978687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] The token cache is being invalidate because project ecc1c89a883445b49c2935b6908cc949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:20:03.978999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.979632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:03.981215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1232/2441] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:20:03 2022] DELETE /identity/v3/projects/ecc1c89a883445b49c2935b6908cc949 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:20:14.290918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:14.292444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:14.351721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941d12-a4b7-4702-97bc-9df293583591 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:14.401598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:14.402271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:14.402537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:14.402806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:14.404801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:14.478646 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:14.480147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:14.491522 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1210/2442] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:14.499170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:14.500786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:14.513918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030094b0-2253-416c-9e42-a512dc730fa7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:14.517898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:14.518501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:14.518777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:14.519043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:14.521174 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:14.607420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:14.609265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102cc6b-99a0-45d6-bb8d-1cb6f92fd568 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:14.628606 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1233/2443] 10.222.0.30 () {60 vars in 1396 bytes} [Mon Apr 4 06:20:14 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:15.117792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:15.120870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:15.141289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872114e-c9ac-480c-8997-62652bbeab5c service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:15.148347 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:15.149020 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:15.149280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:15.149545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:15.151604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:15.243596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:15.245459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:15.264579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1211/2444] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:23.176472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c312352-ef8e-4c1f-a84e-737d6cec499b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:23.177008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c312352-ef8e-4c1f-a84e-737d6cec499b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:23.177008 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c312352-ef8e-4c1f-a84e-737d6cec499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:23.196272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5c312352-ef8e-4c1f-a84e-737d6cec499b None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:23.197524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5c312352-ef8e-4c1f-a84e-737d6cec499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:23.256533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1234/2445] 10.222.0.30 () {58 vars in 967 bytes} [Mon Apr 4 06:20:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:23.273470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:23.275813 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:23.364258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31715a-0df2-4d00-a5d0-9478b55d1e4b service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:23.371040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:23.371694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:23.371973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:23.372199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:23.381319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:23.382935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:23.391236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1212/2446] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:20:30.088450 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:30.089061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:30.089061 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:30.107188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] MFA Rules not processed for user `cea36666ab2947d8bf2a6abbc197be7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:30.108337 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:30.164323 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1235/2447] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:39.740244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:39.741817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:39.814110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab27fe0-67aa-49c2-aa9e-25809710e497 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:39.818174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:39.820029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:39.820497 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:39.821099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:39.823873 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:39.838534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:39.841521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:39.861299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1213/2448] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:45.128858 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:45.144052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a026-7d35-4899-af26-999038de0ad6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:45.149246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:45.149897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:45.150175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:45.150443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:45.152695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:45.217029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:45.218467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:45.228369 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1236/2449] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:48.698258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:48.699857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:48.716669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935fe5-90f8-4bf8-920f-4ecb93e3720e service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:48.721649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:48.722465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:48.722750 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:48.723022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] PATH_INFO: `/v3/users/8b9373968e9c4eca8a038854815796ae` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:48.724691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9373968e9c4eca8a038854815796ae)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:48.726979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:48.774691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9373968e9c4eca8a038854815796ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:48.781395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9373968e9c4eca8a038854815796ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:48.791764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9373968e9c4eca8a038854815796ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:48.792467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9373968e9c4eca8a038854815796ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:48.793226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e07366a-a62b-461e-8e2b-2a8f4a8c5ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9373968e9c4eca8a038854815796ae'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:48.812633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1214/2450] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:20:48 2022] DELETE /identity/v3/users/8b9373968e9c4eca8a038854815796ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:49.007194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.018510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8ff96-0615-4ddf-95a9-f2c86b76f93c service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.076103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.076982 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.077261 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.077530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] PATH_INFO: `/v3/projects/3bf2aa8f9fc74712aac7ec691de75582` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.078733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf2aa8f9fc74712aac7ec691de75582)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.080667 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.128473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf2aa8f9fc74712aac7ec691de75582', 'request_id': 'req-4be50412-1176-4c76-802d-09d84454c847'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:49.137785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf2aa8f9fc74712aac7ec691de75582', 'request_id': 'req-4be50412-1176-4c76-802d-09d84454c847'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:49.143212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf2aa8f9fc74712aac7ec691de75582', 'request_id': 'req-4be50412-1176-4c76-802d-09d84454c847'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:49.153835 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] The token cache is being invalidate because project 3bf2aa8f9fc74712aac7ec691de75582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:20:49.154108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:49.154799 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4be50412-1176-4c76-802d-09d84454c847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:49.156359 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1237/2451] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:20:49 2022] DELETE /identity/v3/projects/3bf2aa8f9fc74712aac7ec691de75582 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:49.161525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.161819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.162094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.181111 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:49.182330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:49.249973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1215/2452] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:49.261860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.262178 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.262546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.285163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:49.286380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:49.295278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1238/2453] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:49.299687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.310580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2e72c-87cb-48e6-9009-1832e0cd2599 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.317296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.317961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.318241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.318515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.319243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:20:49.319550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.321218 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.334816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1216/2454] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:20:49.339142 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.348966 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c8d6-370e-4630-a461-b43e90f1aaad None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.355079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.355736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.356017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.356287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.357007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.358907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.388840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1239/2455] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:49.394834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.405654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e011-e4f3-46de-bb17-613061d0f7d1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.468658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.469365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.469643 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.469908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.470624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.472580 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.494689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1217/2456] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:49.498934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.509926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d557014-28ef-495b-9798-28b7bb3b7485 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.514465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.515130 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.515453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.515682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.516392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.518040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.528550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1240/2457] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:20:49.532631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.543734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3dac3-e4f5-4571-a1f5-10d946e942a5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.548603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852384a-8903-4e77-94a9-d579996491ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.549386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852384a-8903-4e77-94a9-d579996491ff admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.549667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852384a-8903-4e77-94a9-d579996491ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.549940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852384a-8903-4e77-94a9-d579996491ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.550671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852384a-8903-4e77-94a9-d579996491ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.552286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852384a-8903-4e77-94a9-d579996491ff admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.562581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1218/2458] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:49.566932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.577919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8fc83-508b-4ce5-8b51-0f43c6623523 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.582857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.583742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.584063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.584490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] PATH_INFO: `/v3/projects/4b2559ef23314be59e91fcf895079707/users/797f4ca525874eda943fe2117b81ca83/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.598960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2559ef23314be59e91fcf895079707, user_id=797f4ca525874eda943fe2117b81ca83, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.602069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.617579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1241/2459] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:49 2022] PUT /identity/v3/projects/4b2559ef23314be59e91fcf895079707/users/797f4ca525874eda943fe2117b81ca83/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:49.628684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.628982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.629265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.657744 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] MFA Rules not processed for user `797f4ca525874eda943fe2117b81ca83`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:49.658962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:49.727113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1219/2460] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:49.729468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.801302 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c395-0651-446b-95ea-f2983e081edb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.807375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.808027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.808269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.808570 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.809289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.811198 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.843872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1242/2461] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:49.845117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.857225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f8d7c-806c-4d62-98c7-0c2b8f3f4dd1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.913864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.914523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.914809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.915067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.915738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.917751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.939189 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1220/2462] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:20:49 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:49.943317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.956681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5ebca-4a5f-42e3-8507-9f79c037a463 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:49.963752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:49.964774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:49.965084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:49.965501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:49.966282 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:49.968540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:49.980116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1243/2463] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:20:49.984309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:49.995140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374aa58-c7aa-4a36-b1c3-c715b297d301 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:50.001232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:50.002130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:50.002409 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:50.002686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] PATH_INFO: `/v3/projects/91df6994e7a1434c9cd6d535e04171b0/users/5e14ece0be2e4ea283a889e7876b1a10/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:50.019100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df6994e7a1434c9cd6d535e04171b0, user_id=5e14ece0be2e4ea283a889e7876b1a10, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:50.021863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:50.038630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1221/2464] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:49 2022] PUT /identity/v3/projects/91df6994e7a1434c9cd6d535e04171b0/users/5e14ece0be2e4ea283a889e7876b1a10/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:50.042810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:50.053024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802db70-0194-4379-bb4a-31f4b889b6f2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:50.125055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb60e-aeca-4426-aa10-d9fccae651e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:50.125911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb60e-aeca-4426-aa10-d9fccae651e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:50.126216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb60e-aeca-4426-aa10-d9fccae651e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:50.126500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb60e-aeca-4426-aa10-d9fccae651e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:50.127540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb60e-aeca-4426-aa10-d9fccae651e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:50.129960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb60e-aeca-4426-aa10-d9fccae651e7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:50.146278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1244/2465] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:50.153188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:50.168229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5128e-f7a1-4cae-bf1a-777ea332b2bb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:50.174264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:50.175157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:50.175436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:50.175709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] PATH_INFO: `/v3/projects/91df6994e7a1434c9cd6d535e04171b0/users/5e14ece0be2e4ea283a889e7876b1a10/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:50.178038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df6994e7a1434c9cd6d535e04171b0, user_id=5e14ece0be2e4ea283a889e7876b1a10, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:50.180663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:50.191242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1222/2466] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:50 2022] PUT /identity/v3/projects/91df6994e7a1434c9cd6d535e04171b0/users/5e14ece0be2e4ea283a889e7876b1a10/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:50.201520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:50.201818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:50.202078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:50.229785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] MFA Rules not processed for user `5e14ece0be2e4ea283a889e7876b1a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:50.230984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:50.301064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1245/2467] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:50.313350 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:50.316326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:50.373237 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35eeab-a482-42d0-9e7a-a6a5a33dbdef admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:50.377730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:50.378362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:50.378636 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:50.378904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:50.389180 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:50.390608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:50.400466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1223/2468] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:50.477741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:50.487234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcfba0-0885-496a-9c6f-aa82c2986001 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:50.490987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc457a2-4c05-4075-9463-6dcbb11a7cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:50.491629 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc457a2-4c05-4075-9463-6dcbb11a7cce service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:50.491904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc457a2-4c05-4075-9463-6dcbb11a7cce service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:50.492175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc457a2-4c05-4075-9463-6dcbb11a7cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:50.551101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc457a2-4c05-4075-9463-6dcbb11a7cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:50.552537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc457a2-4c05-4075-9463-6dcbb11a7cce service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:50.561900 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1246/2469] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:53.318598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:53.392808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2eb1-66b8-484e-9552-3426c83bf8c9 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:53.400103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:53.401012 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:53.401295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:53.401566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] PATH_INFO: `/v3/users/797f4ca525874eda943fe2117b81ca83` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:53.402894 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797f4ca525874eda943fe2117b81ca83)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:53.404817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:53.467195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797f4ca525874eda943fe2117b81ca83'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:53.479927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797f4ca525874eda943fe2117b81ca83'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:53.490823 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797f4ca525874eda943fe2117b81ca83'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:53.491676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797f4ca525874eda943fe2117b81ca83'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:53.492351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797f4ca525874eda943fe2117b81ca83'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:53.513691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1224/2470] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:20:53 2022] DELETE /identity/v3/users/797f4ca525874eda943fe2117b81ca83 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:53.519023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:53.519546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:53.519546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:53.546781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:53.548763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:53.626945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1247/2471] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:53.640181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:53.642881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:53.714185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a1ad-a33e-451e-b15e-be389895a789 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:53.718289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:53.718968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:53.719247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:53.719521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:53.730743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:53.733073 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:53.746454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1225/2472] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:54.041717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:54.043591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:54.056610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0cea6-ce14-43d1-ab4f-8d3a2aa3dfd4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:54.061777 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:54.062644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:54.062918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:54.063577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] PATH_INFO: `/v3/projects/4b2559ef23314be59e91fcf895079707` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:54.064433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2559ef23314be59e91fcf895079707)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:54.066385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:54.115120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2559ef23314be59e91fcf895079707', 'request_id': 'req-023b0e50-4a18-4224-87da-b6c0abfef2b2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.123718 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2559ef23314be59e91fcf895079707', 'request_id': 'req-023b0e50-4a18-4224-87da-b6c0abfef2b2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.129037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2559ef23314be59e91fcf895079707', 'request_id': 'req-023b0e50-4a18-4224-87da-b6c0abfef2b2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.140176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] The token cache is being invalidate because project 4b2559ef23314be59e91fcf895079707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:20:54.140456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.141143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.142754 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1248/2473] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:20:54 2022] DELETE /identity/v3/projects/4b2559ef23314be59e91fcf895079707 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:54.146904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:54.157803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a997d-b202-4470-bef9-69e59d0c8aee service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:54.226689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:54.227485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:54.227765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:54.228034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] PATH_INFO: `/v3/users/5e14ece0be2e4ea283a889e7876b1a10` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:54.229297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e14ece0be2e4ea283a889e7876b1a10)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:54.231210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:54.282745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e14ece0be2e4ea283a889e7876b1a10'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.289720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e14ece0be2e4ea283a889e7876b1a10'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.297352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e14ece0be2e4ea283a889e7876b1a10'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.298093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e14ece0be2e4ea283a889e7876b1a10'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.298879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dcdce55-4807-4dc8-b2f6-4be3a35fcfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e14ece0be2e4ea283a889e7876b1a10'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.315398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1226/2474] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:20:54 2022] DELETE /identity/v3/users/5e14ece0be2e4ea283a889e7876b1a10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:54.589551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:54.591260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:54.605522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b0e50-4a18-4224-87da-b6c0abfef2b2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:54.663836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:54.664738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:54.665055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:54.665330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] PATH_INFO: `/v3/projects/91df6994e7a1434c9cd6d535e04171b0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:54.666589 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91df6994e7a1434c9cd6d535e04171b0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:54.668563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:54.720727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91df6994e7a1434c9cd6d535e04171b0', 'request_id': 'req-878cafb3-0204-4e4f-8519-a14ea700ca03'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.729112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91df6994e7a1434c9cd6d535e04171b0', 'request_id': 'req-878cafb3-0204-4e4f-8519-a14ea700ca03'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.735326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91df6994e7a1434c9cd6d535e04171b0', 'request_id': 'req-878cafb3-0204-4e4f-8519-a14ea700ca03'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.747240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] The token cache is being invalidate because project 91df6994e7a1434c9cd6d535e04171b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:20:54.747533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.748184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-878cafb3-0204-4e4f-8519-a14ea700ca03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:54.750026 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1249/2475] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:20:54 2022] DELETE /identity/v3/projects/91df6994e7a1434c9cd6d535e04171b0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:54.755001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:54.755526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:54.755526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:54.775367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:54.776467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:54.986994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1227/2476] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:54.994955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:54.995248 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:54.995522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.015341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:55.016525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:55.025540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1250/2477] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:55.032405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.045174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2deda-68f5-4d6f-9182-db00d752d24a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.050652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.051313 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.051586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.051827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.052548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:20:55.052841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.054457 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.069615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1228/2478] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:20:55.074985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.089833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3a6f3-e3d3-455d-b0ec-5c078e6ec2c5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.097875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.098587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.098868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.099186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.100202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.102370 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.133836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1251/2479] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:55 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:20:55.137961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.149177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a9a0c-fb14-44fa-9904-006ac6df04f7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.205385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.206071 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.206322 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.206592 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.207279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.209207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.233959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1229/2480] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:20:55 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:20:55.246785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.249855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106f25b-dbd2-4332-8559-6e710186f539 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.254917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.255590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.255887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.256137 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.257312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.258995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.270020 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1252/2481] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:55.274437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.284863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ddbc2-f316-47a7-ae34-f20b1a2da1d4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.290599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d1c48-4f8c-4fbb-a0c8-e5a01639a1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.291261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1c48-4f8c-4fbb-a0c8-e5a01639a1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.291530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1c48-4f8c-4fbb-a0c8-e5a01639a1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.291774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1c48-4f8c-4fbb-a0c8-e5a01639a1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.292505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d1c48-4f8c-4fbb-a0c8-e5a01639a1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.294124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d1c48-4f8c-4fbb-a0c8-e5a01639a1e2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.305232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1230/2482] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:55.309512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.320529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054d542-2bf1-426e-8d07-8892101926e4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.325893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.326883 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.327166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.327441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] PATH_INFO: `/v3/projects/e298b76b0f8d42de8993adc009d12aa5/users/657fc1b4b9f54c459d734c1e721d679d/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.342445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e298b76b0f8d42de8993adc009d12aa5, user_id=657fc1b4b9f54c459d734c1e721d679d, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.345127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.361260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1253/2483] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:55 2022] PUT /identity/v3/projects/e298b76b0f8d42de8993adc009d12aa5/users/657fc1b4b9f54c459d734c1e721d679d/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:55.372864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.373176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.373449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.400025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] MFA Rules not processed for user `657fc1b4b9f54c459d734c1e721d679d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:55.401235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:55.470176 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1231/2484] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:55.475057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.537828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc224ff-8da0-4269-996b-13b013314852 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.542465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.543177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.543454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.543725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.544419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.546329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.574417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1254/2485] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:55 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:55.578760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.589573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73862aee-0b69-450c-b940-b7b83e9068a1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.647256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.647964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.648243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.648511 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.649302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.651244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.671163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1232/2486] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:20:55 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:20:55.675331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.686330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8342-a8ba-42eb-992c-f36eada1aac1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.692117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.692829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.693147 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.693560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.694632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.696255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.706514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1255/2487] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:20:55.710947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.721604 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a554d-66c7-4244-bb0b-59b3313dc91e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.728197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.729124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.729399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.729672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] PATH_INFO: `/v3/projects/8803115bf097482aae65a54a55e7e9dd/users/da4b9a7390a64c1d9ba2c15a6063095f/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.745789 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8803115bf097482aae65a54a55e7e9dd, user_id=da4b9a7390a64c1d9ba2c15a6063095f, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.748422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.762883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1233/2488] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:55 2022] PUT /identity/v3/projects/8803115bf097482aae65a54a55e7e9dd/users/da4b9a7390a64c1d9ba2c15a6063095f/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:55.766978 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.776818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e751a2-a2b9-438d-ae12-25b3621e8a8f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.834484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994396ed-a86b-4337-b10d-513ef294a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.835324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994396ed-a86b-4337-b10d-513ef294a3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.835649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994396ed-a86b-4337-b10d-513ef294a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.835929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994396ed-a86b-4337-b10d-513ef294a3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.836647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994396ed-a86b-4337-b10d-513ef294a3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.838367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994396ed-a86b-4337-b10d-513ef294a3bc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.851988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1256/2489] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:55.853214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:55.863644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dff19-1f7d-41cc-87bc-d3a47da6d7a8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:55.868324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:55.869268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.869540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.869786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] PATH_INFO: `/v3/projects/8803115bf097482aae65a54a55e7e9dd/users/da4b9a7390a64c1d9ba2c15a6063095f/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.871720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8803115bf097482aae65a54a55e7e9dd, user_id=da4b9a7390a64c1d9ba2c15a6063095f, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:55.874542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:55.886382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1234/2490] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:55 2022] PUT /identity/v3/projects/8803115bf097482aae65a54a55e7e9dd/users/da4b9a7390a64c1d9ba2c15a6063095f/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:55.900372 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:55.900657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:55.900963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:55.929849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] MFA Rules not processed for user `da4b9a7390a64c1d9ba2c15a6063095f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:55.931098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:56.003504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1257/2491] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:56.015660 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:56.017705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:56.078244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24713063-0fc8-40c4-812f-3c7c3a0ed8ae admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:56.082633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5960-da94-4072-94e6-ca7aa285f53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:56.083299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5960-da94-4072-94e6-ca7aa285f53f service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:56.083610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5960-da94-4072-94e6-ca7aa285f53f service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:56.083870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5960-da94-4072-94e6-ca7aa285f53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:56.094800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5960-da94-4072-94e6-ca7aa285f53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:56.096211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5960-da94-4072-94e6-ca7aa285f53f service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:56.107561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1235/2492] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:20:57.549028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:57.610467 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf7a5-1163-4d06-9b5d-b05827318c40 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:57.616246 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:57.617153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:57.617428 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:57.617708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] PATH_INFO: `/v3/users/657fc1b4b9f54c459d734c1e721d679d` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:57.618952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657fc1b4b9f54c459d734c1e721d679d)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:57.620874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:57.670354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657fc1b4b9f54c459d734c1e721d679d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:57.677101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657fc1b4b9f54c459d734c1e721d679d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:57.689392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657fc1b4b9f54c459d734c1e721d679d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:57.699097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657fc1b4b9f54c459d734c1e721d679d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:57.699721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657fc1b4b9f54c459d734c1e721d679d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:57.706203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1258/2493] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:20:57 2022] DELETE /identity/v3/users/657fc1b4b9f54c459d734c1e721d679d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:57.711400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:57.711879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:57.711994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:57.730390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:57.731574 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:57.791335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1236/2494] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:57.801089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:57.802550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:57.858847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74bec-dfa1-42aa-9e43-3e8122214844 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:57.862560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:57.863204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:57.863485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:57.863759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:57.872859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:57.874315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:57.884419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1259/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:20:58.174317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:58.175796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:58.192677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055509-ea68-4706-a90c-e5029d6b7e45 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:58.197952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:58.198817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:58.199095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:58.199367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] PATH_INFO: `/v3/projects/e298b76b0f8d42de8993adc009d12aa5` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:58.200688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e298b76b0f8d42de8993adc009d12aa5)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:58.202484 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:58.249588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e298b76b0f8d42de8993adc009d12aa5', 'request_id': 'req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.257546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e298b76b0f8d42de8993adc009d12aa5', 'request_id': 'req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.263743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e298b76b0f8d42de8993adc009d12aa5', 'request_id': 'req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.273876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] The token cache is being invalidate because project e298b76b0f8d42de8993adc009d12aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:20:58.274131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.274875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.276525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1237/2496] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:20:58 2022] DELETE /identity/v3/projects/e298b76b0f8d42de8993adc009d12aa5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:58.280812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:58.291045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcc0e-f65c-410d-b8dd-0fd425b16ba2 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:58.354827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:58.355887 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:58.356169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:58.356440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] PATH_INFO: `/v3/users/da4b9a7390a64c1d9ba2c15a6063095f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:58.357679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4b9a7390a64c1d9ba2c15a6063095f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:58.359597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:58.411480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4b9a7390a64c1d9ba2c15a6063095f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.418623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4b9a7390a64c1d9ba2c15a6063095f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.431112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4b9a7390a64c1d9ba2c15a6063095f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.439232 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4b9a7390a64c1d9ba2c15a6063095f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.439959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-94679ed6-0acb-45ff-949d-f35a372ffe05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4b9a7390a64c1d9ba2c15a6063095f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.446297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1260/2497] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:20:58 2022] DELETE /identity/v3/users/da4b9a7390a64c1d9ba2c15a6063095f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:58.731649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:58.733336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:58.748135 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e18f5-4265-48c7-b316-0d9df24f4d5a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:58.813315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:58.814190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:58.814459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:58.814729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] PATH_INFO: `/v3/projects/8803115bf097482aae65a54a55e7e9dd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:58.816110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8803115bf097482aae65a54a55e7e9dd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:58.818265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:58.870486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8803115bf097482aae65a54a55e7e9dd', 'request_id': 'req-94207292-0473-4c4b-89b4-a422bc66c9e9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.878107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8803115bf097482aae65a54a55e7e9dd', 'request_id': 'req-94207292-0473-4c4b-89b4-a422bc66c9e9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.885112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8803115bf097482aae65a54a55e7e9dd', 'request_id': 'req-94207292-0473-4c4b-89b4-a422bc66c9e9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.895247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] The token cache is being invalidate because project 8803115bf097482aae65a54a55e7e9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:20:58.895520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.896168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-94207292-0473-4c4b-89b4-a422bc66c9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:20:58.897796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1238/2498] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:20:58 2022] DELETE /identity/v3/projects/8803115bf097482aae65a54a55e7e9dd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:58.902764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:58.903226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:58.903333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:58.922879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:58.924045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:58.984379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1261/2499] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:58.992444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:58.992723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:58.993037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.013648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:59.015186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:59.027670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1239/2500] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:59.029665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.045341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa35b7-bc80-4719-ac98-6a5edaede8e2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.056619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.057371 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.057650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.057929 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.058657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:20:59.058958 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.060673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.081731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1262/2501] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:20:59.082970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.094486 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbdc36-a66d-44bd-a9ca-16118700a8e9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.099640 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.100398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.100684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.100982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.102133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.104010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.154724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1240/2502] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:59.158990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.171720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d96f63-fac5-49e7-83c0-eff120506db4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.241613 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.242209 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.242488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.242759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.243473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.245468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.271345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1263/2503] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:59.275535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.287644 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f566d-b47e-4f1c-9a65-09e905d1afac admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.293418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.294399 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.294564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.294895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.295624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.297268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.307787 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1241/2504] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:59.312122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.322869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e12e8a-0faf-40bb-a62f-ade2ff159978 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.328415 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7aabe-3c6b-4113-87a7-16f7fe23b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.329140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7aabe-3c6b-4113-87a7-16f7fe23b1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.329421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7aabe-3c6b-4113-87a7-16f7fe23b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.329695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7aabe-3c6b-4113-87a7-16f7fe23b1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.330430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7aabe-3c6b-4113-87a7-16f7fe23b1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.332028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7aabe-3c6b-4113-87a7-16f7fe23b1c1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.343025 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1264/2505] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:59.347569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.357676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c799f-7bb0-46b1-a404-6dd3486337b6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.363832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.364766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.365334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.365480 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] PATH_INFO: `/v3/projects/22d5ab85bb6c4eacb431fbe199de6173/users/1235313470534f40a2f83ca60d01017d/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.381426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d5ab85bb6c4eacb431fbe199de6173, user_id=1235313470534f40a2f83ca60d01017d, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.384841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.400852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1242/2506] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:59 2022] PUT /identity/v3/projects/22d5ab85bb6c4eacb431fbe199de6173/users/1235313470534f40a2f83ca60d01017d/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:59.414741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.414741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.414741 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.441981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] MFA Rules not processed for user `1235313470534f40a2f83ca60d01017d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:59.443203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:59.510140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1265/2507] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:59.514631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.579850 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaffd2-5bc1-4a68-aad1-39519a388357 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.585207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.585907 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.586232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.586425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.587128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.589101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.615069 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1243/2508] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:59.620009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.631961 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a5cc6-803e-4ec2-a63e-de4c4b123508 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.701720 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.702984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.703281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.703528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.704247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.706321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.733608 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1266/2509] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:20:59.735377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.746924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af30a-9363-411f-99b5-0be3f95d11ce admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.752254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.753046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.753400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.753742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.754621 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.756831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.768458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1244/2510] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:20:59.772626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.782802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a98ce-c6bd-4243-a7cc-0fc883c47469 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.788607 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dff37-549b-4429-9fd1-7d2cf997335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.789316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dff37-549b-4429-9fd1-7d2cf997335a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.789601 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dff37-549b-4429-9fd1-7d2cf997335a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.789851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dff37-549b-4429-9fd1-7d2cf997335a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.790583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dff37-549b-4429-9fd1-7d2cf997335a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.792199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dff37-549b-4429-9fd1-7d2cf997335a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.802635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1267/2511] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:20:59.808586 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:20:59.819247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2288-4a64-4915-a642-7f9c088d380f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:20:59.824708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:20:59.825659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.825908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.826187 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] PATH_INFO: `/v3/projects/c59ca2ecac2648b583bce046375fcf88/users/eb66491c1bca4c3a8d41a10edaf31ebb/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.846437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59ca2ecac2648b583bce046375fcf88, user_id=eb66491c1bca4c3a8d41a10edaf31ebb, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:20:59.849406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:20:59.863678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1245/2512] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:20:59 2022] PUT /identity/v3/projects/c59ca2ecac2648b583bce046375fcf88/users/eb66491c1bca4c3a8d41a10edaf31ebb/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:20:59.874143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:20:59.874436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:20:59.874714 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:20:59.901315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] MFA Rules not processed for user `eb66491c1bca4c3a8d41a10edaf31ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:20:59.902587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:20:59.973698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1268/2513] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:20:59.978236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.041268 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f1e8c-24a6-497d-aaa4-94433e3e476a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.046338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f988304-006a-4013-9056-2720890e612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.046984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f988304-006a-4013-9056-2720890e612f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.047255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f988304-006a-4013-9056-2720890e612f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.047521 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f988304-006a-4013-9056-2720890e612f admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.048207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f988304-006a-4013-9056-2720890e612f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.050151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f988304-006a-4013-9056-2720890e612f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.082997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1246/2514] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:20:59 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:00.088511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.099847 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc857e-3198-4e8f-867d-fef86b762461 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.169675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.170383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.170666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.170943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.171647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.173622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.195612 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1269/2515] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:00 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:00.199716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f988304-006a-4013-9056-2720890e612f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.210403 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f988304-006a-4013-9056-2720890e612f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.215776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.216129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.216471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.216747 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.217516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.219103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.230103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1247/2516] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:00.234379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.244357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904841-3e1d-47bb-add3-d614300c94d7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.249501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.250392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.250876 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.251030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] PATH_INFO: `/v3/projects/6c1e6f33ed044d5ca86df4bda0aaf19b/users/eb09ea28c2444d09b6f440d4896fd06a/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.266770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1e6f33ed044d5ca86df4bda0aaf19b, user_id=eb09ea28c2444d09b6f440d4896fd06a, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.269563 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.283822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1270/2517] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:00 2022] PUT /identity/v3/projects/6c1e6f33ed044d5ca86df4bda0aaf19b/users/eb09ea28c2444d09b6f440d4896fd06a/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:00.287944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.298400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb579-e9b3-4f6a-8926-217ba47a1c6e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.354759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23996-9070-45c1-b6b6-f026a5668222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.355426 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23996-9070-45c1-b6b6-f026a5668222 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.355729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23996-9070-45c1-b6b6-f026a5668222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.355952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23996-9070-45c1-b6b6-f026a5668222 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.356723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23996-9070-45c1-b6b6-f026a5668222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.358517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23996-9070-45c1-b6b6-f026a5668222 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.369267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1248/2518] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:00.373465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.384674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b67e-85dd-4120-a6b1-dc827ceeb624 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.389674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.390561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.390842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.391132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] PATH_INFO: `/v3/projects/6c1e6f33ed044d5ca86df4bda0aaf19b/users/eb09ea28c2444d09b6f440d4896fd06a/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.393254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1e6f33ed044d5ca86df4bda0aaf19b, user_id=eb09ea28c2444d09b6f440d4896fd06a, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.395862 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.406972 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1271/2519] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:00 2022] PUT /identity/v3/projects/6c1e6f33ed044d5ca86df4bda0aaf19b/users/eb09ea28c2444d09b6f440d4896fd06a/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:00.418181 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.418601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.418739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.453419 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] MFA Rules not processed for user `eb09ea28c2444d09b6f440d4896fd06a`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:00.454647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:00.472536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.474405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:00.521990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1249/2520] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:00.532303 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b85ef-07d3-4d77-9348-564b0ed7f2a8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.533251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.534687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:00.536052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.536817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.537022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.537306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.539103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:00.589803 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f9c9c-5c66-4ed3-93c1-2853749971b3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.593517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.594170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.594453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.594725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.602012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.603469 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.603725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.605265 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.613024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1272/2521] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:21:00.615681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1250/2522] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:21:00.661221 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:00.662699 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:00.674434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2e62-293a-4649-b81b-fec96bd7b0ab service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:00.678802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546d9e-7f00-4888-b03b-67cb3eeee597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:00.679728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546d9e-7f00-4888-b03b-67cb3eeee597 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:00.680016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546d9e-7f00-4888-b03b-67cb3eeee597 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:00.680288 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546d9e-7f00-4888-b03b-67cb3eeee597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:00.738609 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546d9e-7f00-4888-b03b-67cb3eeee597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:00.740238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546d9e-7f00-4888-b03b-67cb3eeee597 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:00.749559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1273/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:03.658230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:03.681969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c67d-3c1b-43ff-8eb2-56e146bee969 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:03.698719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:03.699613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:03.699892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:03.700165 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] PATH_INFO: `/v3/users/1235313470534f40a2f83ca60d01017d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:03.701569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1235313470534f40a2f83ca60d01017d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:03.703512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:03.775531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1235313470534f40a2f83ca60d01017d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:03.785289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1235313470534f40a2f83ca60d01017d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:03.801550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1235313470534f40a2f83ca60d01017d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:03.802253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1235313470534f40a2f83ca60d01017d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:03.804971 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1235313470534f40a2f83ca60d01017d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:03.822155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1251/2524] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:03 2022] DELETE /identity/v3/users/1235313470534f40a2f83ca60d01017d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:03.826753 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:03.827291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:03.827483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:03.847092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:03.848409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:03.910750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1274/2525] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:03.921100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:03.922602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:03.986794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136efbf-0e9e-4a03-9117-d829d58d0a03 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:03.990546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:03.991223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:03.991493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:03.991767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:04.001926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:04.003386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:04.014053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1252/2526] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:04.310310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:04.311760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:04.325140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc181c-ec33-4776-b1f3-7cbcda0423dc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:04.331239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:04.332343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:04.332842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:04.333342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] PATH_INFO: `/v3/projects/22d5ab85bb6c4eacb431fbe199de6173` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:04.335132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d5ab85bb6c4eacb431fbe199de6173)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:04.337205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:04.386838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d5ab85bb6c4eacb431fbe199de6173', 'request_id': 'req-7836bfa7-130a-477e-9b92-459cec8c1d9a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.394758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d5ab85bb6c4eacb431fbe199de6173', 'request_id': 'req-7836bfa7-130a-477e-9b92-459cec8c1d9a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.400728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d5ab85bb6c4eacb431fbe199de6173', 'request_id': 'req-7836bfa7-130a-477e-9b92-459cec8c1d9a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.411703 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] The token cache is being invalidate because project 22d5ab85bb6c4eacb431fbe199de6173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:04.411985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.412647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.414585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1275/2527] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:04 2022] DELETE /identity/v3/projects/22d5ab85bb6c4eacb431fbe199de6173 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:04.419064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:04.428703 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd472c3-0094-4941-8bdf-60132a035ca7 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:04.484420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:04.485364 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:04.485631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:04.485904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] PATH_INFO: `/v3/users/eb66491c1bca4c3a8d41a10edaf31ebb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:04.487142 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb66491c1bca4c3a8d41a10edaf31ebb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:04.489097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:04.539673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb66491c1bca4c3a8d41a10edaf31ebb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.546432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb66491c1bca4c3a8d41a10edaf31ebb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.555423 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb66491c1bca4c3a8d41a10edaf31ebb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.556281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb66491c1bca4c3a8d41a10edaf31ebb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.556979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb66491c1bca4c3a8d41a10edaf31ebb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:04.578927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1253/2528] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:04 2022] DELETE /identity/v3/users/eb66491c1bca4c3a8d41a10edaf31ebb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:04.983003 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:04.984687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:04.998605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836bfa7-130a-477e-9b92-459cec8c1d9a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:05.072462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:05.073389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:05.073669 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:05.073922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] PATH_INFO: `/v3/projects/c59ca2ecac2648b583bce046375fcf88` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:05.075182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59ca2ecac2648b583bce046375fcf88)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:05.077143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:05.127880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59ca2ecac2648b583bce046375fcf88', 'request_id': 'req-0d21900c-3273-4d7a-96c9-d5734acca3a1'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.138038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59ca2ecac2648b583bce046375fcf88', 'request_id': 'req-0d21900c-3273-4d7a-96c9-d5734acca3a1'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.144091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59ca2ecac2648b583bce046375fcf88', 'request_id': 'req-0d21900c-3273-4d7a-96c9-d5734acca3a1'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.156818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] The token cache is being invalidate because project c59ca2ecac2648b583bce046375fcf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:05.157353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.158383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.160348 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1276/2529] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:04 2022] DELETE /identity/v3/projects/c59ca2ecac2648b583bce046375fcf88 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:05.164259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:05.165855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:05.179267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1e137-7c20-4666-8966-3d6902032a39 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:05.247917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:05.248804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:05.249116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:05.249388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] PATH_INFO: `/v3/users/eb09ea28c2444d09b6f440d4896fd06a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:05.250585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb09ea28c2444d09b6f440d4896fd06a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:05.252546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:05.300188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb09ea28c2444d09b6f440d4896fd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.307320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb09ea28c2444d09b6f440d4896fd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.315954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb09ea28c2444d09b6f440d4896fd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.316562 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb09ea28c2444d09b6f440d4896fd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.317289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-801e526f-151a-40a0-8b49-8cd12349a6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb09ea28c2444d09b6f440d4896fd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.335397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1254/2530] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:05 2022] DELETE /identity/v3/users/eb09ea28c2444d09b6f440d4896fd06a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:05.709975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:05.712501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:05.740083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21900c-3273-4d7a-96c9-d5734acca3a1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:05.801240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:05.802113 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:05.802398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:05.807354 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] PATH_INFO: `/v3/projects/6c1e6f33ed044d5ca86df4bda0aaf19b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:05.810212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1e6f33ed044d5ca86df4bda0aaf19b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:05.812217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:05.870842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1e6f33ed044d5ca86df4bda0aaf19b', 'request_id': 'req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.884036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1e6f33ed044d5ca86df4bda0aaf19b', 'request_id': 'req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.890210 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1e6f33ed044d5ca86df4bda0aaf19b', 'request_id': 'req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.901686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] The token cache is being invalidate because project 6c1e6f33ed044d5ca86df4bda0aaf19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:05.902017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.902770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68632ff3-dfd7-42e2-9b8d-664ee6e1f304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:05.908772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1277/2531] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:05 2022] DELETE /identity/v3/projects/6c1e6f33ed044d5ca86df4bda0aaf19b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:05.910587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:05.910872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:05.911141 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:05.932087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:05.933658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:06.007185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1255/2532] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:06.008686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.009196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.009292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.030802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:06.032027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:06.040804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1278/2533] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:06.045269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.055557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053edce-6f78-420d-b6c1-aa0371899321 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.060243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.060948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.061233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.061505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.062240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:06.062543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.064212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.077582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1256/2534] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:21:06.082146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.091696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0856f28-7399-4197-80a6-47965e84abcb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.097258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.097946 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.098226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.098502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.099208 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.101441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.132950 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1279/2535] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:06.135320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.145831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462f630-93b4-4ac9-849b-794bfa9b643f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.210359 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.211262 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.211565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.211949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.213553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.215571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.238292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1257/2536] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:06.242520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.261940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786da63-1c87-439f-8e27-48ba0cd6804b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.267751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.268995 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.269287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.269564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.270642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.272408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.285796 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1280/2537] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:06.289982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.301756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75d773-1ba9-4af4-a27f-50ff5ba27ea4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.308922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a473c3-def9-4f49-b884-9b18787394d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.309740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a473c3-def9-4f49-b884-9b18787394d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.309996 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a473c3-def9-4f49-b884-9b18787394d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.310274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a473c3-def9-4f49-b884-9b18787394d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.311042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a473c3-def9-4f49-b884-9b18787394d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.313080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a473c3-def9-4f49-b884-9b18787394d2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.323674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1258/2538] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:06.327897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.338520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d583-9b70-4172-ad19-54e8e4fafca2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.343094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.343974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.344249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.344517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] PATH_INFO: `/v3/projects/94bb1ee83bcb417eae7f3af8caf35b58/users/ccd9e731e52c46348340a963b5cef814/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.360529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bb1ee83bcb417eae7f3af8caf35b58, user_id=ccd9e731e52c46348340a963b5cef814, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.363224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.377553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1281/2539] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:06 2022] PUT /identity/v3/projects/94bb1ee83bcb417eae7f3af8caf35b58/users/ccd9e731e52c46348340a963b5cef814/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:06.389485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.389774 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.390051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.417091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] MFA Rules not processed for user `ccd9e731e52c46348340a963b5cef814`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:06.418302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:06.481432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1259/2540] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:06.486874 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.549257 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e877-e79b-4828-afbd-0265af25c09f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.554525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.555233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.555542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.555825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.556709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.558727 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.587037 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1282/2541] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:06.591079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.602065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceab89-0e3f-4fd1-ba56-11b82dd1f014 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.665859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.666588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.666864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.667137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.667895 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.669926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.693860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1260/2542] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:06.698057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.708893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f678c-bf59-4607-b38e-2f0a394c68de admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.714258 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.715126 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.715406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.716049 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.716412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.718523 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.731534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1283/2543] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:06.735745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.746540 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad43f5-296e-471e-ac4f-4ffd67162412 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.751535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.752411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.752690 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.753015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] PATH_INFO: `/v3/projects/adee275dc8e44671aca79fdfaf974caa/users/3d919cb3a0fd43b6a1be1eae642af07d/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.770324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=adee275dc8e44671aca79fdfaf974caa, user_id=3d919cb3a0fd43b6a1be1eae642af07d, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.773635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.796053 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1261/2544] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:06 2022] PUT /identity/v3/projects/adee275dc8e44671aca79fdfaf974caa/users/3d919cb3a0fd43b6a1be1eae642af07d/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:06.797385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.809540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb9c87-1fbb-4504-9399-ecba3a723775 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.884276 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa788e21-0897-442c-b0b7-dd8bcfc3ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.884603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788e21-0897-442c-b0b7-dd8bcfc3ddce admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.884941 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788e21-0897-442c-b0b7-dd8bcfc3ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.885280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788e21-0897-442c-b0b7-dd8bcfc3ddce admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.886023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788e21-0897-442c-b0b7-dd8bcfc3ddce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.888410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788e21-0897-442c-b0b7-dd8bcfc3ddce admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.899245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1284/2545] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:06.903479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:06.916259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99c21-1bed-4d51-b7cd-1fe24fac4cee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:06.921935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:06.924872 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.925185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.925462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] PATH_INFO: `/v3/projects/adee275dc8e44671aca79fdfaf974caa/users/3d919cb3a0fd43b6a1be1eae642af07d/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.927683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=adee275dc8e44671aca79fdfaf974caa, user_id=3d919cb3a0fd43b6a1be1eae642af07d, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:06.930453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:06.941095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1262/2546] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:06 2022] PUT /identity/v3/projects/adee275dc8e44671aca79fdfaf974caa/users/3d919cb3a0fd43b6a1be1eae642af07d/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:06.952824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:06.953143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:06.953420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:06.980233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] MFA Rules not processed for user `3d919cb3a0fd43b6a1be1eae642af07d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:06.981512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:07.055918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1285/2547] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:07.066832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:07.068618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:07.162595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71f95e-2de1-4591-8c5a-83fd28e9f08d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:07.166675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:07.167342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:07.167652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:07.167952 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:07.231949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:07.233386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:07.244610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1263/2548] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:07.348818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:07.351080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:07.424964 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525f0b2-2b68-4d00-bf03-ee945d5dd226 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:07.429849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:07.430721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:07.430994 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:07.431256 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] PATH_INFO: `/v3/users/88ea3e53889047619c9c50a3ceac38ad` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:07.432436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ea3e53889047619c9c50a3ceac38ad)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:07.434394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:07.488182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ea3e53889047619c9c50a3ceac38ad'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.496614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ea3e53889047619c9c50a3ceac38ad'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.510592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ea3e53889047619c9c50a3ceac38ad'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.519346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ea3e53889047619c9c50a3ceac38ad'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.520407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ea3e53889047619c9c50a3ceac38ad'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.528214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1286/2549] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:07 2022] DELETE /identity/v3/users/88ea3e53889047619c9c50a3ceac38ad => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:07.720209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:07.731129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9d00-ca54-4d43-8879-e3299c9fa944 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:07.788650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:07.789571 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:07.789978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:07.790253 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] PATH_INFO: `/v3/projects/8aae5cb5d2cd4798b2d627299a7ccbc1` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:07.791430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aae5cb5d2cd4798b2d627299a7ccbc1)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:07.793382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:07.839855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aae5cb5d2cd4798b2d627299a7ccbc1', 'request_id': 'req-c810c612-ce2f-415f-ae04-859f335cb116'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.847800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aae5cb5d2cd4798b2d627299a7ccbc1', 'request_id': 'req-c810c612-ce2f-415f-ae04-859f335cb116'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.854410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aae5cb5d2cd4798b2d627299a7ccbc1', 'request_id': 'req-c810c612-ce2f-415f-ae04-859f335cb116'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.864789 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] The token cache is being invalidate because project 8aae5cb5d2cd4798b2d627299a7ccbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:07.865139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.866051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:07.867374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1264/2550] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:07 2022] DELETE /identity/v3/projects/8aae5cb5d2cd4798b2d627299a7ccbc1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:07.871573 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:07.873217 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:07.887341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2d6d-97b6-43fa-b7f2-85cf14da401e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:07.943590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:07.944539 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:07.944814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:07.945108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] PATH_INFO: `/v3/users/1db8c9d9016044b7a218b4aa4d22599d` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:07.946388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db8c9d9016044b7a218b4aa4d22599d)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:07.948367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:07.999498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db8c9d9016044b7a218b4aa4d22599d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.008231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db8c9d9016044b7a218b4aa4d22599d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.020414 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db8c9d9016044b7a218b4aa4d22599d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.029504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db8c9d9016044b7a218b4aa4d22599d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.030101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db8c9d9016044b7a218b4aa4d22599d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.036158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1287/2551] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:07 2022] DELETE /identity/v3/users/1db8c9d9016044b7a218b4aa4d22599d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:08.221613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:08.223088 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:08.239686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810c612-ce2f-415f-ae04-859f335cb116 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:08.300039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:08.300926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:08.301206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:08.301475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] PATH_INFO: `/v3/projects/aea7811f577f42db8e75bc26d2b1a764` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:08.302697 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea7811f577f42db8e75bc26d2b1a764)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:08.304962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:08.359563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea7811f577f42db8e75bc26d2b1a764', 'request_id': 'req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.367918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea7811f577f42db8e75bc26d2b1a764', 'request_id': 'req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.377115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea7811f577f42db8e75bc26d2b1a764', 'request_id': 'req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.390624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] The token cache is being invalidate because project aea7811f577f42db8e75bc26d2b1a764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:08.390790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.391536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:08.393235 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1265/2552] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:08 2022] DELETE /identity/v3/projects/aea7811f577f42db8e75bc26d2b1a764 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:11.542270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:11.544117 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:11.616460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abda2cf-8085-44e4-8fc4-ca7cc31733bf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:11.671525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:11.672099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:11.672368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:11.672640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:11.674565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:11.751313 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:11.752772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f28b04-f89c-4136-a1a1-9f463bb61109 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:11.763924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1288/2553] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:16.675804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:16.677821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:16.754049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1802bd-23f3-4a31-b80a-4f3eda3723cb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:16.759842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:16.760785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:16.761100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:16.761402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] PATH_INFO: `/v3/users/ccd9e731e52c46348340a963b5cef814` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:16.762663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd9e731e52c46348340a963b5cef814)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:16.764597 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:16.818317 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd9e731e52c46348340a963b5cef814'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:16.825551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd9e731e52c46348340a963b5cef814'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:16.834499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd9e731e52c46348340a963b5cef814'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:16.835231 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd9e731e52c46348340a963b5cef814'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:16.835887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd9e731e52c46348340a963b5cef814'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:16.854256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1266/2554] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:16 2022] DELETE /identity/v3/users/ccd9e731e52c46348340a963b5cef814 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:16.858861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:16.859365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:16.859484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:16.877193 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:16.878388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:16.941236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1289/2555] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:16.951433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:16.953675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:17.011393 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb12ce0-0954-4aab-883e-246e52559c57 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:17.015558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:17.016206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:17.016482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:17.016754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:17.026370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:17.027830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:17.037459 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1267/2556] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:17.311535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:17.313191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:17.328295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb35a1-9310-4d51-ba51-9c2a0fa67032 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:17.334293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:17.335281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:17.335553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:17.335805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] PATH_INFO: `/v3/projects/94bb1ee83bcb417eae7f3af8caf35b58` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:17.337145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bb1ee83bcb417eae7f3af8caf35b58)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:17.339497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:17.387004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bb1ee83bcb417eae7f3af8caf35b58', 'request_id': 'req-7b4535a8-0546-4774-bf2d-cce2027ecf82'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.395510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bb1ee83bcb417eae7f3af8caf35b58', 'request_id': 'req-7b4535a8-0546-4774-bf2d-cce2027ecf82'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.401153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bb1ee83bcb417eae7f3af8caf35b58', 'request_id': 'req-7b4535a8-0546-4774-bf2d-cce2027ecf82'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.412125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] The token cache is being invalidate because project 94bb1ee83bcb417eae7f3af8caf35b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:17.412404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.413093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.414788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1290/2557] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:17 2022] DELETE /identity/v3/projects/94bb1ee83bcb417eae7f3af8caf35b58 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:17.418968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:17.429100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43e52-5ef5-44f7-83f9-8d2f34be8209 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:17.487969 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:17.488847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:17.489150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:17.489418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] PATH_INFO: `/v3/users/3d919cb3a0fd43b6a1be1eae642af07d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:17.490681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d919cb3a0fd43b6a1be1eae642af07d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:17.492598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:17.548784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d919cb3a0fd43b6a1be1eae642af07d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.556002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d919cb3a0fd43b6a1be1eae642af07d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.565527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d919cb3a0fd43b6a1be1eae642af07d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.566456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d919cb3a0fd43b6a1be1eae642af07d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.567170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c293e9c2-9aa8-42c4-b7b0-e8af6b07c9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d919cb3a0fd43b6a1be1eae642af07d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:17.585090 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1268/2558] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:17 2022] DELETE /identity/v3/users/3d919cb3a0fd43b6a1be1eae642af07d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:17.876860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:17.878362 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:17.893890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4535a8-0546-4774-bf2d-cce2027ecf82 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:17.954028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:17.954880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:17.955154 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:17.955425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] PATH_INFO: `/v3/projects/adee275dc8e44671aca79fdfaf974caa` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:17.956707 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=adee275dc8e44671aca79fdfaf974caa)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:17.958638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.015949 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adee275dc8e44671aca79fdfaf974caa', 'request_id': 'req-52ad6f10-d9b4-4d74-b15b-35278a597ddd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.024203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adee275dc8e44671aca79fdfaf974caa', 'request_id': 'req-52ad6f10-d9b4-4d74-b15b-35278a597ddd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.030379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adee275dc8e44671aca79fdfaf974caa', 'request_id': 'req-52ad6f10-d9b4-4d74-b15b-35278a597ddd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.041578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] The token cache is being invalidate because project adee275dc8e44671aca79fdfaf974caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:18.042960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.043689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52ad6f10-d9b4-4d74-b15b-35278a597ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.045294 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1291/2559] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:17 2022] DELETE /identity/v3/projects/adee275dc8e44671aca79fdfaf974caa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:18.051741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.052282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.052282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.071056 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:18.072270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:18.142848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1269/2560] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:18.154530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.154903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.155263 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.184817 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:18.186679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:18.200585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1292/2561] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:18.204752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.215706 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a836e5-aadb-4e30-9fe4-2fd51f095502 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.221667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.222326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.222614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.222874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.223594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:18.223896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.225532 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.238510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1270/2562] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:18.243104 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.253280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220359-9e7e-4939-b156-dc102fd8724e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.258925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.259583 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.259860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.260127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.260891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.262928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.294254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1293/2563] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:18 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:18.298310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.308568 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce151033-9d0a-4a0a-b45b-66d393b2f418 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.382370 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.383062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.383340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.383633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.384382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.386422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.408685 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1271/2564] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:18 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:18.412627 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.423688 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5289-762a-4d2e-ab17-54db2abdf7cd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.429681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.430368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.430643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.430911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.431632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.433551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.444275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1294/2565] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:18.448283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.458927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432ede-89ea-4c92-8a69-cea009034adf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.464655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73400d3-347a-499f-8b4b-6f8228bc0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.465348 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73400d3-347a-499f-8b4b-6f8228bc0296 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.465627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73400d3-347a-499f-8b4b-6f8228bc0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.465919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73400d3-347a-499f-8b4b-6f8228bc0296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.466642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73400d3-347a-499f-8b4b-6f8228bc0296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.468226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73400d3-347a-499f-8b4b-6f8228bc0296 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.479269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1272/2566] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:18.485651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.499532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851ff8b-7c8d-4bb1-b286-a307bdc25101 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.505486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.506374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.506679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.507316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] PATH_INFO: `/v3/projects/ef9caa9120b74f56a40868b8b3cb5681/users/a55e4bb054dd4a9abefc1e996f0c6b29/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.522187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9caa9120b74f56a40868b8b3cb5681, user_id=a55e4bb054dd4a9abefc1e996f0c6b29, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.524845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.540045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1295/2567] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:18 2022] PUT /identity/v3/projects/ef9caa9120b74f56a40868b8b3cb5681/users/a55e4bb054dd4a9abefc1e996f0c6b29/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:18.552390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.552755 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.553171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.581498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] MFA Rules not processed for user `a55e4bb054dd4a9abefc1e996f0c6b29`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:18.582678 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:18.660371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1273/2568] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:18.675513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.677692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:18.738734 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba171-55ef-4029-90c8-97a937dcd2ed admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.742746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499bb9d-f5d2-4bc5-9ee5-bc45503f3aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.743389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499bb9d-f5d2-4bc5-9ee5-bc45503f3aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.743661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499bb9d-f5d2-4bc5-9ee5-bc45503f3aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.743932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499bb9d-f5d2-4bc5-9ee5-bc45503f3aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.752335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499bb9d-f5d2-4bc5-9ee5-bc45503f3aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.753819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499bb9d-f5d2-4bc5-9ee5-bc45503f3aa7 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.763073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1296/2569] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:18.781968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:18.854754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1d423-ac08-45aa-933d-4a1c7a74be6a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:18.861442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:18.862354 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.862628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.862896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] PATH_INFO: `/v3/users/a55e4bb054dd4a9abefc1e996f0c6b29` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.864255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55e4bb054dd4a9abefc1e996f0c6b29)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:18.866182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:18.921144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55e4bb054dd4a9abefc1e996f0c6b29'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.927726 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55e4bb054dd4a9abefc1e996f0c6b29'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.936186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55e4bb054dd4a9abefc1e996f0c6b29'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.936805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55e4bb054dd4a9abefc1e996f0c6b29'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.937553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55e4bb054dd4a9abefc1e996f0c6b29'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:18.964938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1274/2570] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:18 2022] DELETE /identity/v3/users/a55e4bb054dd4a9abefc1e996f0c6b29 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:18.972083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:18.972638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:18.972767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:18.993166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:18.994357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:19.060516 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1297/2571] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:19.072134 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.074170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:19.141248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd4fb-7531-4d42-97a9-6c7115699d66 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.148025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28fc93-9b51-4cdc-b889-079bdadb128d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.149097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28fc93-9b51-4cdc-b889-079bdadb128d service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.149549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28fc93-9b51-4cdc-b889-079bdadb128d service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.151615 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28fc93-9b51-4cdc-b889-079bdadb128d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.164270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28fc93-9b51-4cdc-b889-079bdadb128d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.165743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28fc93-9b51-4cdc-b889-079bdadb128d service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.176283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1275/2572] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:19.457421 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.459041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:19.472028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cad0-71d9-4df2-a164-5cc2359325e5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.477557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.478894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.479186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.479452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] PATH_INFO: `/v3/projects/ef9caa9120b74f56a40868b8b3cb5681` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.481234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9caa9120b74f56a40868b8b3cb5681)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.484352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.532658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9caa9120b74f56a40868b8b3cb5681', 'request_id': 'req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:19.540632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9caa9120b74f56a40868b8b3cb5681', 'request_id': 'req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:19.546262 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9caa9120b74f56a40868b8b3cb5681', 'request_id': 'req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:19.557051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] The token cache is being invalidate because project ef9caa9120b74f56a40868b8b3cb5681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:19.557356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:19.558063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1d0ef0ac-7662-4a57-a2b2-8390ba1e53d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:19.559751 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1298/2573] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:19 2022] DELETE /identity/v3/projects/ef9caa9120b74f56a40868b8b3cb5681 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:19.565912 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.566190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.566467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.591040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:19.592926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:19.658827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1276/2574] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:19.666859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.667211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.667497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.687308 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:19.688530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:19.697055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1299/2575] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:19.701475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.711294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fa15b-71af-4c43-825d-3bc7e3d1f21d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.716966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.717627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.717908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.718184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.718909 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:19.719215 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.720818 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.732877 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1277/2576] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:19.737431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.749116 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92eb31-536f-4558-b608-c9e7b88ca969 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.755985 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.756646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.757343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.757621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.758316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.760238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.798268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1300/2577] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:19 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:19.802575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.815866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a9faf-c462-4711-a752-a863a48f27e0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.882558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.883223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.883518 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.883777 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.884464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.886835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.908602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1278/2578] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:19 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:19.914903 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.931991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6747-d6c7-4733-aa3e-26bc3887aed9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.938089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.938758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.939038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.939310 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.940040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.941690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.952723 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1301/2579] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:19.956842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:19.967792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34438ffa-c118-491a-aea1-59ccf9a68486 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:19.974546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f33f7-4fb7-48aa-94bb-7a731cd654e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:19.975219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f33f7-4fb7-48aa-94bb-7a731cd654e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:19.975492 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f33f7-4fb7-48aa-94bb-7a731cd654e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:19.975754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f33f7-4fb7-48aa-94bb-7a731cd654e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:19.976479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f33f7-4fb7-48aa-94bb-7a731cd654e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:19.978117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f33f7-4fb7-48aa-94bb-7a731cd654e1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:19.989599 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1279/2580] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:19.993933 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:20.004378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf3ab4-4817-4e64-bbbd-76e7d61b3ab2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:20.010378 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:20.011271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:20.011553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:20.011829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] PATH_INFO: `/v3/projects/14946d1748a94a62b19553a98f67ce9b/users/36992b0f716348c8ada462ee5172088a/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:20.027170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14946d1748a94a62b19553a98f67ce9b, user_id=36992b0f716348c8ada462ee5172088a, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:20.029880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:20.045878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1302/2581] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:19 2022] PUT /identity/v3/projects/14946d1748a94a62b19553a98f67ce9b/users/36992b0f716348c8ada462ee5172088a/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:20.061674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:20.061960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:20.062232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:20.088851 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] MFA Rules not processed for user `36992b0f716348c8ada462ee5172088a`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:20.090888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:20.168811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1280/2582] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:20.180615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:20.182937 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:20.243984 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356c19-b1d3-4d74-a4e1-83d74bcc9de2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:20.248255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136f056-4007-41a2-b091-580a08af8966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:20.248926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f056-4007-41a2-b091-580a08af8966 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:20.249227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f056-4007-41a2-b091-580a08af8966 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:20.249500 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136f056-4007-41a2-b091-580a08af8966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:20.258632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136f056-4007-41a2-b091-580a08af8966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:20.260076 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136f056-4007-41a2-b091-580a08af8966 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:20.269212 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1303/2583] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:22.823596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:22.888023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c6880-17d6-4351-9cfd-f739427eea55 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:22.892835 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:22.893729 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:22.894002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:22.894250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] PATH_INFO: `/v3/users/36992b0f716348c8ada462ee5172088a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:22.895553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36992b0f716348c8ada462ee5172088a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:22.897506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:22.945438 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36992b0f716348c8ada462ee5172088a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:22.952455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36992b0f716348c8ada462ee5172088a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:22.960778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36992b0f716348c8ada462ee5172088a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:22.962129 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36992b0f716348c8ada462ee5172088a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:22.962743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36992b0f716348c8ada462ee5172088a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:22.981530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1281/2584] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:22 2022] DELETE /identity/v3/users/36992b0f716348c8ada462ee5172088a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:22.985882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:22.986396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:22.986396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.005746 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:23.007314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.068463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1304/2585] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:23.079788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.081372 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.142978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c1a64-751b-4ef1-a014-31ada1e4ce13 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.146958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.147603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.147878 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.148133 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.157769 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:23.159179 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:23.169761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1282/2586] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:23.406650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.409859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.463132 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.466099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.483972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677045bd-ec24-4d92-a95d-4e0d2dc96e2f service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.494280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.495156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.495431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.495700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] PATH_INFO: `/v3/projects/14946d1748a94a62b19553a98f67ce9b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.500523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14946d1748a94a62b19553a98f67ce9b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:23.502525 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:23.533063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea541f-df0f-4c1f-8c74-7bbefa26fa55 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.546528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.547634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.548060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.548433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.551082 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.566491 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:23.568620 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0044973-dd2d-4368-a39d-0af8d43d4e93 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:23.576652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14946d1748a94a62b19553a98f67ce9b', 'request_id': 'req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:23.583143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1305/2587] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:23.591441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14946d1748a94a62b19553a98f67ce9b', 'request_id': 'req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:23.599382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14946d1748a94a62b19553a98f67ce9b', 'request_id': 'req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:23.611692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] The token cache is being invalidate because project 14946d1748a94a62b19553a98f67ce9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:23.611976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:23.612647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-17bc7444-e7bc-4fe3-96e2-9117b4ce20d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:23.614591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1283/2588] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:23 2022] DELETE /identity/v3/projects/14946d1748a94a62b19553a98f67ce9b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:23.620506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15526802-8be3-4d76-a006-a5b37066643d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.621186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15526802-8be3-4d76-a006-a5b37066643d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.621532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15526802-8be3-4d76-a006-a5b37066643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.649999 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-15526802-8be3-4d76-a006-a5b37066643d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:23.651390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15526802-8be3-4d76-a006-a5b37066643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.710621 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1306/2589] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:23.719064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.719355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.719657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.739021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:23.740219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:23.749002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1284/2590] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:23.753155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15526802-8be3-4d76-a006-a5b37066643d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.763732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15526802-8be3-4d76-a006-a5b37066643d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.768848 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.769555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.769845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.770119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.770851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:23.771160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:23.772773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:23.785159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1307/2591] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:23.789836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.802913 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7df31-966c-49c4-b8e3-bd3b156de220 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.810194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.810989 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.811277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.811551 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.812289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:23.814288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:23.850271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1285/2592] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:23 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:23.851461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.866745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6363da-93e6-4b17-b8e9-b19c830832bf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.938893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.939725 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.940043 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.940269 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:23.941000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:23.942916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:23.968143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1308/2593] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:23 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:23.971356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:23.992212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc78f9-6ded-4d7a-96d9-4353cf73bfb9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:23.997948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:23.998686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:23.998973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:23.999380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:24.000113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:24.001759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:24.013602 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1286/2594] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:24.017684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:24.027968 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9189f-9e6a-4a4b-8d51-1489a740da6e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:24.032566 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425f268-ca63-46e0-9a3b-cf4265fe16de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:24.033259 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f268-ca63-46e0-9a3b-cf4265fe16de admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:24.033538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f268-ca63-46e0-9a3b-cf4265fe16de admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:24.033803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f268-ca63-46e0-9a3b-cf4265fe16de admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:24.034524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425f268-ca63-46e0-9a3b-cf4265fe16de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:24.036127 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425f268-ca63-46e0-9a3b-cf4265fe16de admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:24.046446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1309/2595] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:24.050106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:24.059916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cdcf4-0704-47e9-8662-56d9ac61a966 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:24.064736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:24.065625 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:24.065902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:24.066172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] PATH_INFO: `/v3/projects/68988ae34214443380cdb8f4c7433802/users/f9dfd20af1874415be353e22a59ecbfc/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:24.080731 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68988ae34214443380cdb8f4c7433802, user_id=f9dfd20af1874415be353e22a59ecbfc, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:24.083386 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:24.098717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1287/2596] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:24 2022] PUT /identity/v3/projects/68988ae34214443380cdb8f4c7433802/users/f9dfd20af1874415be353e22a59ecbfc/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:24.103908 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:24.104140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:24.104417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:24.123089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:24.124340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:24.186412 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1310/2597] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:24.199790 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:24.201684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:24.263435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132b11-2640-405f-84ff-cd21dad98989 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:24.267232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c2ac-b13a-4c6c-9342-98c2beeadb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:24.267885 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c2ac-b13a-4c6c-9342-98c2beeadb03 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:24.268163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c2ac-b13a-4c6c-9342-98c2beeadb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:24.268436 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c2ac-b13a-4c6c-9342-98c2beeadb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:24.277672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561c2ac-b13a-4c6c-9342-98c2beeadb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:24.279091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561c2ac-b13a-4c6c-9342-98c2beeadb03 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:24.290588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1288/2598] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:27.750544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:27.761228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3ecb3-41f2-45bf-b7cc-30086a66051d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:27.766224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:27.767222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:27.768098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:27.768603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:27.771341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:27.788180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:27.790661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:27.811144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1311/2599] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:28.509534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:28.510365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:28.510817 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:28.542311 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] MFA Rules not processed for user `f9dfd20af1874415be353e22a59ecbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:28.544082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:28.620945 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1289/2600] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:28.624436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:28.640445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309dc50-4a9a-4cd4-8366-6d33f0c455b2 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:28.645590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:28.646596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:28.647060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:28.647479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:28.648330 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:28.650611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:28.682896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1312/2601] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:28 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:28.684230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:28.695716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228a4fa-cb5b-4a4b-9ff2-44eb5bd689c6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:28.758435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:28.759388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:28.759388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:28.759696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:28.760501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:28.763177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:28.790279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1290/2602] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:28 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:28.798069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:28.822041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb1ac7-e41f-461a-9972-85ac1467ca4d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:28.828639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:28.829387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:28.829673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:28.830092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:28.830673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:28.832293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:28.847019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1313/2603] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:28.850917 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:28.868030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac1cf-b04b-4e1b-bdcc-1d4a38afa1d0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:28.874114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:28.875414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:28.876366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:28.876651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] PATH_INFO: `/v3/projects/b579d521e0cf45ebab46a26cd6aed8a7/users/7e2bfa491d4d48fdada0c7b1949bfcd7/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:28.903688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b579d521e0cf45ebab46a26cd6aed8a7, user_id=7e2bfa491d4d48fdada0c7b1949bfcd7, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:28.906421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:28.933530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1291/2604] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:28 2022] PUT /identity/v3/projects/b579d521e0cf45ebab46a26cd6aed8a7/users/7e2bfa491d4d48fdada0c7b1949bfcd7/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:28.936889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:28.948204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257ec96-1853-4c31-afaa-23d81a111fcd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:29.050891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:29.051485 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:29.051766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:29.052038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:29.053148 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:29.054548 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:29.069039 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1314/2605] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:29.073295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:29.084461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e284f-681b-4a02-848d-4e53f890f9ed admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:29.091229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:29.092705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:29.093021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:29.093306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] PATH_INFO: `/v3/projects/b579d521e0cf45ebab46a26cd6aed8a7/users/7e2bfa491d4d48fdada0c7b1949bfcd7/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:29.095784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b579d521e0cf45ebab46a26cd6aed8a7, user_id=7e2bfa491d4d48fdada0c7b1949bfcd7, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:29.099339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:29.118266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1292/2606] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:29 2022] PUT /identity/v3/projects/b579d521e0cf45ebab46a26cd6aed8a7/users/7e2bfa491d4d48fdada0c7b1949bfcd7/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:31.784472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:31.784472 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:31.816806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453404ef-48ae-4735-b507-c4c2346534d9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:31.885928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:31.887394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:31.888110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:31.888572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] PATH_INFO: `/v3/users/8d1c1bb5571f4b5cbde6b417c04ac484` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:31.891161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1c1bb5571f4b5cbde6b417c04ac484)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:31.893374 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:31.948721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1c1bb5571f4b5cbde6b417c04ac484'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:31.956947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1c1bb5571f4b5cbde6b417c04ac484'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:31.972173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1c1bb5571f4b5cbde6b417c04ac484'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:31.985598 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1c1bb5571f4b5cbde6b417c04ac484'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:31.986987 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-003a8aeb-68c7-43f9-9d09-f6f417c70723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1c1bb5571f4b5cbde6b417c04ac484'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:32.000637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1315/2607] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:31 2022] DELETE /identity/v3/users/8d1c1bb5571f4b5cbde6b417c04ac484 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:32.226733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.228585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:32.247054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba897-2570-44a3-b9ab-1eb007e3dc0a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:32.331001 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:32.332037 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.332462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.332754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] PATH_INFO: `/v3/projects/eb48c2dfec0b435e978641e49934d2c0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.333998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb48c2dfec0b435e978641e49934d2c0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:32.335910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:32.396499 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb48c2dfec0b435e978641e49934d2c0', 'request_id': 'req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:32.406970 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb48c2dfec0b435e978641e49934d2c0', 'request_id': 'req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:32.414605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb48c2dfec0b435e978641e49934d2c0', 'request_id': 'req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:32.428277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] The token cache is being invalidate because project eb48c2dfec0b435e978641e49934d2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:32.428587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:32.429220 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6f4fef99-5fde-4faa-9e4a-d9ec41a93dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:32.430924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1293/2608] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:32 2022] DELETE /identity/v3/projects/eb48c2dfec0b435e978641e49934d2c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:32.436218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.436578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.436940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.459885 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:32.461152 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:32.537057 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1316/2609] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:32.544080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.544468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.544875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.566467 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:32.568553 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:32.580937 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1294/2610] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:32.585367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.595764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf1f6-73fd-45ad-9e9f-a33aeecd2b87 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:32.611866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:32.612696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.613222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.613857 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.614695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:32.615151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:32.617696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:32.645165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1317/2611] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:21:32.646498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.664115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbd86-ee32-4010-a7cf-d1d7f3396d1a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:32.670209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:32.671627 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.672092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.672732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.673558 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:32.675681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:32.712641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1295/2612] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:32 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:32.719824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.737922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9c7d2-505c-43c1-9b2b-35be2289e413 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:32.814066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:32.815497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.815991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.816411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.817444 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:32.819555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:32.853356 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.864179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1318/2613] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:32 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:32.866255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce952e8-bd0b-4981-8d39-85bb9262003e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:32.873360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:32.874329 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.874797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.875279 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.876561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:32.880007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:32.921443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1296/2614] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:32.923063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.934316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632a617-a04d-4355-b95a-7a202b06ec7e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:32.944033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418274f-d05a-45a7-92dc-78d102a08d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:32.946321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418274f-d05a-45a7-92dc-78d102a08d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:32.946612 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418274f-d05a-45a7-92dc-78d102a08d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:32.946894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418274f-d05a-45a7-92dc-78d102a08d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:32.948471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418274f-d05a-45a7-92dc-78d102a08d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:32.952463 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418274f-d05a-45a7-92dc-78d102a08d6d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:32.973708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1319/2615] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:32.975535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:32.991719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4359fe-a88d-48f6-b5b2-5db95273ce9b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:33.002183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:33.003680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:33.004099 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:33.004547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] PATH_INFO: `/v3/projects/ca273cd52ad2415f827e859d9814e0e7/users/dec4f3eb11c64dea8e130cc94803363a/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:33.044613 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca273cd52ad2415f827e859d9814e0e7, user_id=dec4f3eb11c64dea8e130cc94803363a, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:33.049956 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:33.113466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1297/2616] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:32 2022] PUT /identity/v3/projects/ca273cd52ad2415f827e859d9814e0e7/users/dec4f3eb11c64dea8e130cc94803363a/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:33.124919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6f5d-b690-4c4f-b5d5-c82687066383 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:33.125218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6f5d-b690-4c4f-b5d5-c82687066383 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:33.125503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6f5d-b690-4c4f-b5d5-c82687066383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:33.208186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-deea6f5d-b690-4c4f-b5d5-c82687066383 None None] MFA Rules not processed for user `dec4f3eb11c64dea8e130cc94803363a`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:33.209717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-deea6f5d-b690-4c4f-b5d5-c82687066383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:33.338045 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1320/2617] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:33.354026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:33.356477 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:33.503648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf5428-1f5c-404a-bd56-bae802efca1c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:33.532385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:33.533104 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:33.533448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:33.533650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:33.547021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:33.548721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:33.569443 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1298/2618] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:35.244431 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:35.245056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:35.245056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:35.278094 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] MFA Rules not processed for user `7e2bfa491d4d48fdada0c7b1949bfcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:35.279363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:35.357016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1321/2619] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:35.365446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:35.366961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:35.383653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070953e6-eb68-49d0-8e87-257f90e964e0 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:35.395478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:35.396136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:35.396416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:35.396683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:35.398539 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:35.489843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:35.491825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0f418-6022-4fa7-af2d-0de61a7db7be service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:35.512385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1299/2620] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:36.704328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:36.777579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9d7fe-aa8c-497c-97ab-f76a68201eb5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:36.782878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:36.784036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:36.784535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:36.784778 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] PATH_INFO: `/v3/users/dec4f3eb11c64dea8e130cc94803363a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:36.786168 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec4f3eb11c64dea8e130cc94803363a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:36.788324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:36.864089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec4f3eb11c64dea8e130cc94803363a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:36.872319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec4f3eb11c64dea8e130cc94803363a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:36.886533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec4f3eb11c64dea8e130cc94803363a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:36.896605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec4f3eb11c64dea8e130cc94803363a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:36.897293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec4f3eb11c64dea8e130cc94803363a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:36.903911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1322/2621] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:36 2022] DELETE /identity/v3/users/dec4f3eb11c64dea8e130cc94803363a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:36.908211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:36.908689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:36.908802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:36.927465 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:36.928825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:36.993034 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1300/2622] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:37.001533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:37.003618 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:37.069970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1504a4-f42f-4b86-9718-4cc7bee52808 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:37.077604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074d762-32fd-4753-8702-8967676b4f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:37.078266 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074d762-32fd-4753-8702-8967676b4f80 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.078521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074d762-32fd-4753-8702-8967676b4f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.078793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074d762-32fd-4753-8702-8967676b4f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.088757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074d762-32fd-4753-8702-8967676b4f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:37.090435 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074d762-32fd-4753-8702-8967676b4f80 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:37.100590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1323/2623] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:37.446837 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:37.448406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:37.467620 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfed77-cff9-4c79-a4b8-331554e35f48 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:37.473701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:37.474337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.474759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.475367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] PATH_INFO: `/v3/projects/ca273cd52ad2415f827e859d9814e0e7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.476658 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca273cd52ad2415f827e859d9814e0e7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:37.496953 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:37.593101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca273cd52ad2415f827e859d9814e0e7', 'request_id': 'req-dde61056-0c22-4844-9693-07279ea82719'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:37.603497 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca273cd52ad2415f827e859d9814e0e7', 'request_id': 'req-dde61056-0c22-4844-9693-07279ea82719'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:37.611144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca273cd52ad2415f827e859d9814e0e7', 'request_id': 'req-dde61056-0c22-4844-9693-07279ea82719'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:37.624610 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] The token cache is being invalidate because project ca273cd52ad2415f827e859d9814e0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:37.624915 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:37.625573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-dde61056-0c22-4844-9693-07279ea82719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:37.627456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1301/2624] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:37 2022] DELETE /identity/v3/projects/ca273cd52ad2415f827e859d9814e0e7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:37.632666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.633162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.633496 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.655646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:37.657167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:37.739843 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1324/2625] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:37.748479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.749072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.749502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.773809 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:37.775428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:37.783944 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1302/2626] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:37.788350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:37.799109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03481d2b-25ce-462b-804f-8f7b6e6483e2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:37.807521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:37.808305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.808649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.809105 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.810353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:37.810654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:37.812306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:37.824726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1325/2627] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:37.829587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:37.839103 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384fb7-5b0e-4e1b-8204-084d0e0e77b0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:37.848802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:37.849569 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.849845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.850112 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.850799 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:37.852680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:37.880479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1303/2628] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:37 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:37.884868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:37.897546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b7905-d76a-4490-8a0e-9e0755130b6b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:37.959575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:37.960252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:37.960528 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:37.960803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:37.961689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:37.963622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:37.989758 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1326/2629] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:37 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:37.991023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.002427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae7010-eddb-40bb-9746-4566b1b7fdfc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.008213 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.008943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.009219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.009487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.010219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.011820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.025240 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1304/2630] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:38.029893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.040503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf04f9f-8841-455d-b942-fd86d501f330 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.045595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47021607-6c23-4dda-82fa-a379d8b0a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.046297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47021607-6c23-4dda-82fa-a379d8b0a7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.046577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47021607-6c23-4dda-82fa-a379d8b0a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.046909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47021607-6c23-4dda-82fa-a379d8b0a7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.047657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47021607-6c23-4dda-82fa-a379d8b0a7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.049319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47021607-6c23-4dda-82fa-a379d8b0a7ac admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.060820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1327/2631] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:38.064773 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.074975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aed5b-1ac9-4e24-a878-8085a168eb01 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.081455 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.082373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.082650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.082919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] PATH_INFO: `/v3/projects/763d95bcc13e4e66b4f850cc86b909f3/users/191f7313f5e846eb9c432ec5cff7975e/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.097635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763d95bcc13e4e66b4f850cc86b909f3, user_id=191f7313f5e846eb9c432ec5cff7975e, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.100225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.117391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1305/2632] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:38 2022] PUT /identity/v3/projects/763d95bcc13e4e66b4f850cc86b909f3/users/191f7313f5e846eb9c432ec5cff7975e/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:38.128300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.128586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.129292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.157342 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] MFA Rules not processed for user `191f7313f5e846eb9c432ec5cff7975e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:38.158551 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:38.228476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1328/2633] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:38.232893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.304807 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec54bdd-391c-43d8-9240-288377203bd9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.310530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.311244 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.311533 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.311741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.312471 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.314380 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.349983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1306/2634] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:38 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:38.354240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.371636 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2afc6a-1b28-4481-8028-eaafe831b1e8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.446535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.449503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.449503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.449503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.449503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.452095 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.477377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1329/2635] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:38 2022] POST /identity/v3/users => generated 308 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:38.478711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.502979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b5c4-f2b4-424e-9f12-db41e6d24f90 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.508819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.509635 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.509898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.510168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.510908 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.512587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.526990 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1307/2636] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:38.531322 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.541695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f59f76-38e5-4a1b-90c3-0d49714a24b0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.547097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.548089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.548364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.548637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] PATH_INFO: `/v3/projects/6ce2365b68944642aa119e6769f6442e/users/d2c996f1e52740f3bc34ebc6f95cee31/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.565112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce2365b68944642aa119e6769f6442e, user_id=d2c996f1e52740f3bc34ebc6f95cee31, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.567770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.584222 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1330/2637] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:38 2022] PUT /identity/v3/projects/6ce2365b68944642aa119e6769f6442e/users/d2c996f1e52740f3bc34ebc6f95cee31/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:38.588219 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.599775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ab5cc-f9cc-482d-8295-c11f4027a2d5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.665338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a161c3-e6d0-4586-b028-044326e5fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.666039 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a161c3-e6d0-4586-b028-044326e5fd1f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.666319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a161c3-e6d0-4586-b028-044326e5fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.666594 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a161c3-e6d0-4586-b028-044326e5fd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.667326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a161c3-e6d0-4586-b028-044326e5fd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.669876 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a161c3-e6d0-4586-b028-044326e5fd1f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.684078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1308/2638] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:38.685806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.696960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b3168-780e-47db-95e8-230d93e0f14e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.702760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.703801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.704151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.704492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] PATH_INFO: `/v3/projects/6ce2365b68944642aa119e6769f6442e/users/d2c996f1e52740f3bc34ebc6f95cee31/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.706855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce2365b68944642aa119e6769f6442e, user_id=d2c996f1e52740f3bc34ebc6f95cee31, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.710366 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.722379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1331/2639] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:38 2022] PUT /identity/v3/projects/6ce2365b68944642aa119e6769f6442e/users/d2c996f1e52740f3bc34ebc6f95cee31/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:38.734689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.734983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.735236 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.765738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] MFA Rules not processed for user `d2c996f1e52740f3bc34ebc6f95cee31`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:38.766973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:38.838046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1309/2640] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:38.849854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:38.851645 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:38.910586 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0c864-a6fa-4b74-ae25-921efe6c1e84 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:38.914264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0dda-885a-4602-a273-83581e66eae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:38.914922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0dda-885a-4602-a273-83581e66eae9 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:38.915202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0dda-885a-4602-a273-83581e66eae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:38.915479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0dda-885a-4602-a273-83581e66eae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:38.927454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0dda-885a-4602-a273-83581e66eae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:38.928935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0dda-885a-4602-a273-83581e66eae9 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:38.939533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1332/2641] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:39.079994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:39.149162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c421e-3daa-47cc-a49e-c66127efe7a4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:39.154978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:39.155896 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:39.156173 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:39.156448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] PATH_INFO: `/v3/users/191f7313f5e846eb9c432ec5cff7975e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:39.157788 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191f7313f5e846eb9c432ec5cff7975e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:39.159732 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:39.213771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191f7313f5e846eb9c432ec5cff7975e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.221600 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191f7313f5e846eb9c432ec5cff7975e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.230463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191f7313f5e846eb9c432ec5cff7975e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.231207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191f7313f5e846eb9c432ec5cff7975e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.232140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191f7313f5e846eb9c432ec5cff7975e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.250910 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1310/2642] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:39 2022] DELETE /identity/v3/users/191f7313f5e846eb9c432ec5cff7975e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:39.255735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:39.256013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:39.256281 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:39.278481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:39.279882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:39.345286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1333/2643] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:39.355785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:39.357670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:39.425618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484246f-fabf-4dea-80d6-4a717e4ea653 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:39.430880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:39.432060 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:39.432482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:39.432768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:39.444659 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:39.446158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:39.455596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1311/2644] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:39.779443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:39.780849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:39.798249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e48ba-dc39-4b40-b96e-bf143361d035 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:39.809051 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:39.810053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:39.810305 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:39.810600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] PATH_INFO: `/v3/projects/763d95bcc13e4e66b4f850cc86b909f3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:39.811860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763d95bcc13e4e66b4f850cc86b909f3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:39.813893 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:39.864686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763d95bcc13e4e66b4f850cc86b909f3', 'request_id': 'req-e394fe79-86db-4257-a189-9cea40a027a9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.874017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763d95bcc13e4e66b4f850cc86b909f3', 'request_id': 'req-e394fe79-86db-4257-a189-9cea40a027a9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.879829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763d95bcc13e4e66b4f850cc86b909f3', 'request_id': 'req-e394fe79-86db-4257-a189-9cea40a027a9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.891695 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] The token cache is being invalidate because project 763d95bcc13e4e66b4f850cc86b909f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:39.891917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.892574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:39.894160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1334/2645] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:39 2022] DELETE /identity/v3/projects/763d95bcc13e4e66b4f850cc86b909f3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:39.898475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:39.910688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c4444-df1c-43b1-a2bd-cdf5bae1bdd3 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:39.987431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:39.988478 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:39.988793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:39.989157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] PATH_INFO: `/v3/users/d2c996f1e52740f3bc34ebc6f95cee31` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:39.991006 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c996f1e52740f3bc34ebc6f95cee31)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:39.994013 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.047924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c996f1e52740f3bc34ebc6f95cee31'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.054922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c996f1e52740f3bc34ebc6f95cee31'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.063164 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c996f1e52740f3bc34ebc6f95cee31'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.063794 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c996f1e52740f3bc34ebc6f95cee31'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.064456 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-76e685c5-6a98-4ab5-8090-f4d8c1e0ebad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c996f1e52740f3bc34ebc6f95cee31'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.082828 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1312/2646] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:39 2022] DELETE /identity/v3/users/d2c996f1e52740f3bc34ebc6f95cee31 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:40.387189 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.389522 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:40.411270 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394fe79-86db-4257-a189-9cea40a027a9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.468849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.469760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.470042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.470298 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] PATH_INFO: `/v3/projects/6ce2365b68944642aa119e6769f6442e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.471483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce2365b68944642aa119e6769f6442e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:40.473419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.521182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce2365b68944642aa119e6769f6442e', 'request_id': 'req-90da1adc-8d15-4077-be26-bda6d41b312a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.532914 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce2365b68944642aa119e6769f6442e', 'request_id': 'req-90da1adc-8d15-4077-be26-bda6d41b312a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.539215 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce2365b68944642aa119e6769f6442e', 'request_id': 'req-90da1adc-8d15-4077-be26-bda6d41b312a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.551296 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] The token cache is being invalidate because project 6ce2365b68944642aa119e6769f6442e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:40.551623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.552297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-90da1adc-8d15-4077-be26-bda6d41b312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:40.554110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1335/2647] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:40 2022] DELETE /identity/v3/projects/6ce2365b68944642aa119e6769f6442e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:40.560178 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.560461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.560764 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.578879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:40.580153 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:40.648448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1313/2648] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:40.656392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.656683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.656991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.676700 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:40.677965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:40.686728 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1336/2649] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:40.691388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.704246 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eb76a-a331-4198-a968-b30440137818 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.710209 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.710880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.711155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.711422 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.712147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:40.712448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:40.714080 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.726427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1314/2650] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:40.731122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.741207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3c283-69fe-480c-989c-8a6c84b5da4a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.747556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.748234 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.748492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.748769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.749513 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:40.751456 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.782346 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1337/2651] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:40 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:40.786656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.797119 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41fd6c-c36f-4f27-a671-2ed22594738c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.865535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.866210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.866488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.866760 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.867483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:40.869416 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.894617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1315/2652] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:40 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:40.896803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.908099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f55d37-cb90-4ba7-adb3-b97f336580c6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.913525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.914201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.914432 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.914694 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.915489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:40.917140 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.930385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1338/2653] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:40.934743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.945361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd05e8f-fc02-40a4-9ed3-bdddcc12150c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.950490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b90bc-d3a6-4f78-8ca6-7ead0c26ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.950992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b90bc-d3a6-4f78-8ca6-7ead0c26ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.951271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b90bc-d3a6-4f78-8ca6-7ead0c26ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.951546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b90bc-d3a6-4f78-8ca6-7ead0c26ae1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:40.952277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b90bc-d3a6-4f78-8ca6-7ead0c26ae1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:40.953916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b90bc-d3a6-4f78-8ca6-7ead0c26ae1e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:40.964067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1316/2654] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:40.969161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:40.979706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee1bd8-aaa8-43e0-b769-d97c9da66761 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:40.985090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:40.986011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:40.986286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:40.986553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] PATH_INFO: `/v3/projects/204dc8df18a2430ab42809a265933131/users/2a90e280c81541968b7e9ebdae193419/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.001765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=204dc8df18a2430ab42809a265933131, user_id=2a90e280c81541968b7e9ebdae193419, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.004479 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.020050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1339/2655] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:40 2022] PUT /identity/v3/projects/204dc8df18a2430ab42809a265933131/users/2a90e280c81541968b7e9ebdae193419/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:41.031105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.031417 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.031743 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.062992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] MFA Rules not processed for user `2a90e280c81541968b7e9ebdae193419`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:41.064261 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:41.133159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1317/2656] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:41.137888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.203297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700332a9-0acd-4fcb-8f19-25282d770fad admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.208582 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.209273 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.209550 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.209844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.210534 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.212424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.239289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1340/2657] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:41 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:41.243596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.254694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088d443-ef18-42c3-8d5e-ec1b8ec3648a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.313335 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.314022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.314314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.314588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.315288 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.317291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.339748 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1318/2658] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:41 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:41.344202 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.354737 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ba09-b940-413e-9409-a840f77fd28d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.359940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.360611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.360884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.361196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.361960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.363585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.375519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1341/2659] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:41.379781 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.390770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08089e1-f169-4cd7-b3b9-dc5518673d8c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.395819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.396702 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.396978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.397271 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] PATH_INFO: `/v3/projects/bb56cd43026542649a17e4e7d4f454b9/users/17211729e70244f3bd236fd1728b2309/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.413160 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb56cd43026542649a17e4e7d4f454b9, user_id=17211729e70244f3bd236fd1728b2309, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.415901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.431374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1319/2660] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:41 2022] PUT /identity/v3/projects/bb56cd43026542649a17e4e7d4f454b9/users/17211729e70244f3bd236fd1728b2309/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:41.435169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.445900 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec17f90-326b-41a0-92e1-8de337068f92 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.510492 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d92817-3975-4145-920e-0fd9021a008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.511291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92817-3975-4145-920e-0fd9021a008f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.511647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92817-3975-4145-920e-0fd9021a008f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.512014 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92817-3975-4145-920e-0fd9021a008f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.512814 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d92817-3975-4145-920e-0fd9021a008f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.514890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d92817-3975-4145-920e-0fd9021a008f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.528631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1342/2661] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:41.529943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.542587 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1f8c-d640-4e9e-bb0a-ce9585876332 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.547882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.548931 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.549226 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.549501 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] PATH_INFO: `/v3/projects/bb56cd43026542649a17e4e7d4f454b9/users/17211729e70244f3bd236fd1728b2309/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.551673 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb56cd43026542649a17e4e7d4f454b9, user_id=17211729e70244f3bd236fd1728b2309, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.554388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.565596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1320/2662] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:41 2022] PUT /identity/v3/projects/bb56cd43026542649a17e4e7d4f454b9/users/17211729e70244f3bd236fd1728b2309/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:41.578128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.578426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.578791 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.611781 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] MFA Rules not processed for user `17211729e70244f3bd236fd1728b2309`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:41.613080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:41.683509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1343/2663] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:41.695225 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.697169 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:41.755966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b427b-0534-496b-95ad-827b72224d09 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.760361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.761106 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.761362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.761683 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.771319 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.772768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.782712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1321/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:41.830957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:41.832387 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:41.844601 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dafe2-8bd5-415d-93c0-e03d1fcd26f2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:41.848464 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c675e9-4886-4a29-927c-46b7c9203972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:41.849144 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c675e9-4886-4a29-927c-46b7c9203972 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:41.849407 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c675e9-4886-4a29-927c-46b7c9203972 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:41.849681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c675e9-4886-4a29-927c-46b7c9203972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:41.912461 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c675e9-4886-4a29-927c-46b7c9203972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:41.913955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c675e9-4886-4a29-927c-46b7c9203972 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:41.923981 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1344/2665] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:45.261291 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:45.329282 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6dd8-b2d4-4921-8f78-2873746ce374 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:45.335382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:45.336266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:45.336657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:45.336948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] PATH_INFO: `/v3/users/2a90e280c81541968b7e9ebdae193419` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:45.338273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a90e280c81541968b7e9ebdae193419)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:45.340212 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:45.398363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a90e280c81541968b7e9ebdae193419'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:45.407184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a90e280c81541968b7e9ebdae193419'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:45.418027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a90e280c81541968b7e9ebdae193419'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:45.418681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a90e280c81541968b7e9ebdae193419'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:45.419302 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a90e280c81541968b7e9ebdae193419'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:45.437199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1322/2666] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:45 2022] DELETE /identity/v3/users/2a90e280c81541968b7e9ebdae193419 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:45.442365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:45.442875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:45.443028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:45.462339 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:45.463561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:45.530227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1345/2667] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:45.540810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:45.542310 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:45.608816 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646498d-f5f6-4975-b42f-fc24c2f6d429 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:45.613281 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:45.613940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:45.614217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:45.614487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:45.624035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:45.625651 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:45.636572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1323/2668] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:45.911139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:45.912770 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:45.926277 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bb1c7-d436-47f6-a160-a7c4abd0d599 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:45.935096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:45.936041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:45.936437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:45.936715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] PATH_INFO: `/v3/projects/204dc8df18a2430ab42809a265933131` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:45.938065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=204dc8df18a2430ab42809a265933131)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:45.941992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:45.993945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204dc8df18a2430ab42809a265933131', 'request_id': 'req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.003709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204dc8df18a2430ab42809a265933131', 'request_id': 'req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.011584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204dc8df18a2430ab42809a265933131', 'request_id': 'req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.026989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] The token cache is being invalidate because project 204dc8df18a2430ab42809a265933131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:46.027480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.028480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.030752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1346/2669] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:45 2022] DELETE /identity/v3/projects/204dc8df18a2430ab42809a265933131 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:46.035276 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:46.045070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dabc8e-3cf1-4881-925a-bcedeb0d0275 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:46.103900 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:46.104802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.105116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.105389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] PATH_INFO: `/v3/users/17211729e70244f3bd236fd1728b2309` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.106663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17211729e70244f3bd236fd1728b2309)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:46.108603 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:46.160184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17211729e70244f3bd236fd1728b2309'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.167759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17211729e70244f3bd236fd1728b2309'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.177556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17211729e70244f3bd236fd1728b2309'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.178194 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17211729e70244f3bd236fd1728b2309'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.178973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-80ec69c6-7e7b-46c2-b769-b9f672093b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17211729e70244f3bd236fd1728b2309'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.197733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1324/2670] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:46 2022] DELETE /identity/v3/users/17211729e70244f3bd236fd1728b2309 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:46.490333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:46.491786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:46.506238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e8522-c764-4ecd-a9fb-5f7a2a0183fd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:46.563824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:46.565089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.565373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.565643 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] PATH_INFO: `/v3/projects/bb56cd43026542649a17e4e7d4f454b9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.567019 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb56cd43026542649a17e4e7d4f454b9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:46.568960 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:46.621962 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb56cd43026542649a17e4e7d4f454b9', 'request_id': 'req-f70970ac-c1f1-40a9-8375-d562f27963cd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.631623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb56cd43026542649a17e4e7d4f454b9', 'request_id': 'req-f70970ac-c1f1-40a9-8375-d562f27963cd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.638207 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb56cd43026542649a17e4e7d4f454b9', 'request_id': 'req-f70970ac-c1f1-40a9-8375-d562f27963cd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.650505 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] The token cache is being invalidate because project bb56cd43026542649a17e4e7d4f454b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:46.650811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.651503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f70970ac-c1f1-40a9-8375-d562f27963cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:46.653609 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1347/2671] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:46 2022] DELETE /identity/v3/projects/bb56cd43026542649a17e4e7d4f454b9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:46.658767 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.659245 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.659366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.677440 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:46.678841 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:46.752390 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1325/2672] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:46.761078 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.761324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.761602 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.780324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:46.781575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:46.789852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1348/2673] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:46.794537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:46.804439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b53c1-2f89-4f56-921d-3aaafeafca11 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:46.809113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:46.809709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.809983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.810254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.810976 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:46.811277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:46.812871 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:46.824308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1326/2674] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:46.828828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:46.838400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbbc70-72d0-4f24-8518-6a872ee53249 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:46.847287 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:46.847622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.848048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.848247 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.849156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:46.851055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:46.878425 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1349/2675] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:46 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:46.882860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:46.893510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d37e9d-6bb1-4f6f-9743-987af9e5fff4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:46.954672 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:46.955333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:46.955612 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:46.955880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:46.956554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:46.958527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:46.982742 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1327/2676] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:46 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:46.987795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.003503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787b5a7-3808-4df5-9a2b-cf6417e1749d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.009855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.010549 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.010829 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.011093 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.011931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.013742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.024493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1350/2677] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:47.028681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.038962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307503da-e6f9-490f-9239-0d4f79f339d3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.044573 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d6a2-f2f7-4855-878d-d24421103864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.045269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d6a2-f2f7-4855-878d-d24421103864 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.045544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d6a2-f2f7-4855-878d-d24421103864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.045814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d6a2-f2f7-4855-878d-d24421103864 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.046541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d6a2-f2f7-4855-878d-d24421103864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.048387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d6a2-f2f7-4855-878d-d24421103864 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.058439 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1328/2678] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:47.062614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.072591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3bda-4a4f-4927-8c90-fa49b37fcd4c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.077626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.078506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.078776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.079060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] PATH_INFO: `/v3/projects/96b8ff2e2b3f4ddda03052d52b0250cf/users/af3e8e7a91334dd9b89f26cf1cf3d3bb/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.093545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b8ff2e2b3f4ddda03052d52b0250cf, user_id=af3e8e7a91334dd9b89f26cf1cf3d3bb, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.096529 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.114658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1351/2679] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:47 2022] PUT /identity/v3/projects/96b8ff2e2b3f4ddda03052d52b0250cf/users/af3e8e7a91334dd9b89f26cf1cf3d3bb/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:47.127131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.127753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.128185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.161663 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] MFA Rules not processed for user `af3e8e7a91334dd9b89f26cf1cf3d3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:47.162893 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:47.236144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1329/2680] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:47.241214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.306295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411f546-482f-435c-9c42-68099f773bf8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.311458 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.312112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.312382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.312704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.313356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.315328 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.344440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1352/2681] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:47 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:47.349554 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.361024 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a5445-aad1-41e9-8578-f3bad88beda8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.418585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.419258 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.419534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.419805 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.420498 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.422510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.443341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1330/2682] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:47 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:47.449275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.462471 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960c47e-4a30-48f7-957a-d9297c2c0bdf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.467955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.468616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.468932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.469230 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.469955 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.471940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.482931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1353/2683] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:47.487327 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.501863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd640db-a1f7-40e5-b88a-f3208f2054ea admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.510157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.511401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.511811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.512247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] PATH_INFO: `/v3/projects/98c37fab93f94d4ea1a542e7f515ec3a/users/5bf683ac462b4ca2ae189b2cce44bdc3/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.528935 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c37fab93f94d4ea1a542e7f515ec3a, user_id=5bf683ac462b4ca2ae189b2cce44bdc3, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.531617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.546657 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1331/2684] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:47 2022] PUT /identity/v3/projects/98c37fab93f94d4ea1a542e7f515ec3a/users/5bf683ac462b4ca2ae189b2cce44bdc3/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:47.550867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.561112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e675c-99d5-4422-821f-7da903d1e7de admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.622344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6b3bb-8d3d-4f78-a973-5c854d89dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.622926 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b3bb-8d3d-4f78-a973-5c854d89dde9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.623205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b3bb-8d3d-4f78-a973-5c854d89dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.623460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b3bb-8d3d-4f78-a973-5c854d89dde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.624188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b3bb-8d3d-4f78-a973-5c854d89dde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.625836 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b3bb-8d3d-4f78-a973-5c854d89dde9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.636327 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1354/2685] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:47.640575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.651243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926830f9-c2a7-46a1-9a43-a6c49a98e847 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.655992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.656880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.657205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.657460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] PATH_INFO: `/v3/projects/98c37fab93f94d4ea1a542e7f515ec3a/users/5bf683ac462b4ca2ae189b2cce44bdc3/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.659621 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c37fab93f94d4ea1a542e7f515ec3a, user_id=5bf683ac462b4ca2ae189b2cce44bdc3, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.662376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.672942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1332/2686] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:47 2022] PUT /identity/v3/projects/98c37fab93f94d4ea1a542e7f515ec3a/users/5bf683ac462b4ca2ae189b2cce44bdc3/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:47.683533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.683831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.684108 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.712321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] MFA Rules not processed for user `5bf683ac462b4ca2ae189b2cce44bdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:47.713567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:47.786869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1355/2687] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:47.798049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:47.800183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:47.861475 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917935b-c04a-42f8-a27b-51664fb10391 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:47.865523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906f7d6-7d1c-41ab-b32b-eb19f5c8a0c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:47.866171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f7d6-7d1c-41ab-b32b-eb19f5c8a0c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:47.866446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f7d6-7d1c-41ab-b32b-eb19f5c8a0c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:47.866717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f7d6-7d1c-41ab-b32b-eb19f5c8a0c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:47.875962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906f7d6-7d1c-41ab-b32b-eb19f5c8a0c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:47.877429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906f7d6-7d1c-41ab-b32b-eb19f5c8a0c7 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:47.887148 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1333/2688] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:21:48.028055 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:48.098226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7deba4-6df5-498d-b2d0-9d5f16d4349e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:48.103675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:48.104547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:48.104819 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:48.105118 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] PATH_INFO: `/v3/users/af3e8e7a91334dd9b89f26cf1cf3d3bb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:48.106379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3e8e7a91334dd9b89f26cf1cf3d3bb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:48.108321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:48.157810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3e8e7a91334dd9b89f26cf1cf3d3bb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.164454 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3e8e7a91334dd9b89f26cf1cf3d3bb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.177711 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3e8e7a91334dd9b89f26cf1cf3d3bb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.187100 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3e8e7a91334dd9b89f26cf1cf3d3bb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.187793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3e8e7a91334dd9b89f26cf1cf3d3bb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.194227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1356/2689] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:48 2022] DELETE /identity/v3/users/af3e8e7a91334dd9b89f26cf1cf3d3bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:48.198992 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:48.199284 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:48.199548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:48.218230 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:48.219435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:48.280286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1334/2690] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:48.290159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:48.291561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:48.351709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c91b1-d930-4456-a928-dd5d78777e79 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:48.355895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:48.356532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:48.356805 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:48.357120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:48.366555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:48.367975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:48.377373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1357/2691] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:48.649339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:48.650771 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:48.664796 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c427f1-f35e-44e8-892a-7873d93e0406 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:48.671043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:48.671901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:48.672200 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:48.672460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] PATH_INFO: `/v3/projects/96b8ff2e2b3f4ddda03052d52b0250cf` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:48.673596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b8ff2e2b3f4ddda03052d52b0250cf)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:48.675633 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:48.724352 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b8ff2e2b3f4ddda03052d52b0250cf', 'request_id': 'req-1710b74e-eba7-41c2-a224-208eb0663ef8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.732330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b8ff2e2b3f4ddda03052d52b0250cf', 'request_id': 'req-1710b74e-eba7-41c2-a224-208eb0663ef8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.738810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b8ff2e2b3f4ddda03052d52b0250cf', 'request_id': 'req-1710b74e-eba7-41c2-a224-208eb0663ef8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.749175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] The token cache is being invalidate because project 96b8ff2e2b3f4ddda03052d52b0250cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:48.749442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.750057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.751681 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1335/2692] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:48 2022] DELETE /identity/v3/projects/96b8ff2e2b3f4ddda03052d52b0250cf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:48.756103 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:48.766504 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04876be-3707-41d5-9d91-2add4d626d1e service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:48.826890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:48.827761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:48.828042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:48.828317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] PATH_INFO: `/v3/users/5bf683ac462b4ca2ae189b2cce44bdc3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:48.829560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf683ac462b4ca2ae189b2cce44bdc3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:48.831615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:48.880402 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf683ac462b4ca2ae189b2cce44bdc3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.887545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf683ac462b4ca2ae189b2cce44bdc3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.899341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf683ac462b4ca2ae189b2cce44bdc3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.908756 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf683ac462b4ca2ae189b2cce44bdc3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.909574 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-184bb82e-2b45-4bcc-b266-6dd60b44bec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf683ac462b4ca2ae189b2cce44bdc3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:48.915365 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1358/2693] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:48 2022] DELETE /identity/v3/users/5bf683ac462b4ca2ae189b2cce44bdc3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:49.193918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.195527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:49.212234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710b74e-eba7-41c2-a224-208eb0663ef8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.276679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.277514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.277791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.278081 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] PATH_INFO: `/v3/projects/98c37fab93f94d4ea1a542e7f515ec3a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.279432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c37fab93f94d4ea1a542e7f515ec3a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.281365 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.332793 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c37fab93f94d4ea1a542e7f515ec3a', 'request_id': 'req-ee0e2e08-7211-4704-9d6a-1de39b106369'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:49.341116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c37fab93f94d4ea1a542e7f515ec3a', 'request_id': 'req-ee0e2e08-7211-4704-9d6a-1de39b106369'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:49.347814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c37fab93f94d4ea1a542e7f515ec3a', 'request_id': 'req-ee0e2e08-7211-4704-9d6a-1de39b106369'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:49.357862 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] The token cache is being invalidate because project 98c37fab93f94d4ea1a542e7f515ec3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:49.358143 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:49.358783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee0e2e08-7211-4704-9d6a-1de39b106369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:49.360330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1336/2694] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:49 2022] DELETE /identity/v3/projects/98c37fab93f94d4ea1a542e7f515ec3a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:49.366004 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.366285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.366559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.385490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:49.386701 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:49.448040 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1359/2695] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:49.455887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.456168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.456437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.475315 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:49.476516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:49.485821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1337/2696] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:49.489851 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.500181 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed245c-c094-408f-8d9d-ef588f9b2847 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.505801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.506459 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.506736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.507003 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.508073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:49.508391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.510038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.521562 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1360/2697] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:49.525879 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.535395 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19763bf4-53c1-4e41-abcb-7d292e1b9b7d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.541063 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.541715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.542014 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.542278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.542961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.544847 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.571072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1338/2698] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:49 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:49.575111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.585473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550b230-6bed-4cd3-b8c3-c0cfb86d38c0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.643397 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.644063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.644343 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.644615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.645355 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.647311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.669460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1361/2699] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:49 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:49.673768 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.684241 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54806c09-73e5-449a-80d3-3fb66ef61511 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.689030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.689779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.690052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.690326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.691044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.692622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.702831 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1339/2700] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:49.706906 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.717090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84effc-661d-47ad-a693-7cfc98a849b1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.722098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0be1-629e-4de7-996e-4b62c17b3794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.722759 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0be1-629e-4de7-996e-4b62c17b3794 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.723022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0be1-629e-4de7-996e-4b62c17b3794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.723293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0be1-629e-4de7-996e-4b62c17b3794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.724079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0be1-629e-4de7-996e-4b62c17b3794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.725704 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0be1-629e-4de7-996e-4b62c17b3794 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.735544 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1362/2701] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:49.741374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.754211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4fe4-940a-4e5a-b8c3-8205a90d0db4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.759469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.760333 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.760608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.760864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] PATH_INFO: `/v3/projects/2ebe5da3ff5d439b81dee5e6bb8bb838/users/abb242d9ebc5449a855ba6143e33f824/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.775121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebe5da3ff5d439b81dee5e6bb8bb838, user_id=abb242d9ebc5449a855ba6143e33f824, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.777906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:49.793836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1340/2702] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:49 2022] PUT /identity/v3/projects/2ebe5da3ff5d439b81dee5e6bb8bb838/users/abb242d9ebc5449a855ba6143e33f824/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:49.805201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.805702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.805702 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.832742 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] MFA Rules not processed for user `abb242d9ebc5449a855ba6143e33f824`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:49.833976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:49.898300 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1363/2703] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:49.902821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:49.970506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958882f0-ccb8-4dbd-8b5e-951c2e07e989 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:49.976114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:49.976780 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:49.977094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:49.977367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:49.978056 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:49.979958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.009552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1341/2704] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:49 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:50.013834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.025160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39c77a-c5f6-4e69-8f1f-a711a22634b6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.079569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.080436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.080865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.081196 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.081895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.083824 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.105509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1364/2705] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:50 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:50.109614 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.120000 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc436fb-7c36-4862-ad9b-e193c99a5137 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.124579 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.125266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.125547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.125814 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.126535 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.128166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.138785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1342/2706] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:50.143417 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.153680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e094a-cf20-4997-9f42-9e354f6cc714 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.159661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.160537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.160820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.161124 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] PATH_INFO: `/v3/projects/47982b79746d4b78a7aeee7236b42cb1/users/8d34edc1b03c4e2eae0f782380340b65/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.178071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47982b79746d4b78a7aeee7236b42cb1, user_id=8d34edc1b03c4e2eae0f782380340b65, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.180733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.200129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1365/2707] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:50 2022] PUT /identity/v3/projects/47982b79746d4b78a7aeee7236b42cb1/users/8d34edc1b03c4e2eae0f782380340b65/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:50.206043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.219298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83248403-c832-4897-8f9d-04da240a34fe admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.285381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac14ac2-9b91-4899-bdfc-38b5c3d5bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.286046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac14ac2-9b91-4899-bdfc-38b5c3d5bddf admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.286326 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac14ac2-9b91-4899-bdfc-38b5c3d5bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.286601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac14ac2-9b91-4899-bdfc-38b5c3d5bddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.287332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac14ac2-9b91-4899-bdfc-38b5c3d5bddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.288966 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac14ac2-9b91-4899-bdfc-38b5c3d5bddf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.299074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1343/2708] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:50.305157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.317139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d887bc-6fdd-4d18-8036-74ebd7b92e2a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.325345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.326675 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.327083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.327498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] PATH_INFO: `/v3/projects/47982b79746d4b78a7aeee7236b42cb1/users/8d34edc1b03c4e2eae0f782380340b65/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.330852 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47982b79746d4b78a7aeee7236b42cb1, user_id=8d34edc1b03c4e2eae0f782380340b65, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.333494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.345098 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1366/2709] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:50 2022] PUT /identity/v3/projects/47982b79746d4b78a7aeee7236b42cb1/users/8d34edc1b03c4e2eae0f782380340b65/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:50.355792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.356076 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.356349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.384735 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] MFA Rules not processed for user `8d34edc1b03c4e2eae0f782380340b65`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:50.385993 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:50.457277 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1344/2710] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:50.468772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.470788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:50.530739 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce289e-ca85-4c54-a0fb-1e031c333395 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.536345 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.537030 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.537312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.537587 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.547029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.548482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.557884 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1367/2711] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:50.644667 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:50.655044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f7ab6-791d-4b10-9218-cb4286d45bca None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:50.659588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b7596-2fe6-408d-b9e4-dcd1c77a1bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:50.660224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b7596-2fe6-408d-b9e4-dcd1c77a1bad service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:50.660500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b7596-2fe6-408d-b9e4-dcd1c77a1bad service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:50.660776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b7596-2fe6-408d-b9e4-dcd1c77a1bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:50.725462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b7596-2fe6-408d-b9e4-dcd1c77a1bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:50.726906 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b7596-2fe6-408d-b9e4-dcd1c77a1bad service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:50.735954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1345/2712] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:55.529943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:55.603451 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51862b-314a-4632-b009-5df068dc70d0 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:55.609902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:55.610825 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:55.611111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:55.611379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] PATH_INFO: `/v3/users/abb242d9ebc5449a855ba6143e33f824` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:55.612830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb242d9ebc5449a855ba6143e33f824)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:55.614764 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:55.670437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb242d9ebc5449a855ba6143e33f824'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:55.677243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb242d9ebc5449a855ba6143e33f824'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:55.688654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb242d9ebc5449a855ba6143e33f824'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:55.696530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb242d9ebc5449a855ba6143e33f824'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:55.697250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb242d9ebc5449a855ba6143e33f824'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:55.703347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1368/2713] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:55 2022] DELETE /identity/v3/users/abb242d9ebc5449a855ba6143e33f824 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:55.708694 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:55.709233 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:55.709344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:55.731645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:55.732874 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:55.810947 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1346/2714] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:55.823530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:55.825297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:55.885502 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28292dd-2fd9-4a5c-8648-86c41d01797d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:55.889730 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:55.890384 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:55.890661 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:55.890935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:55.900788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:55.902332 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:55.912064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1369/2715] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:56.216946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:56.218700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:56.232468 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74430c-cb8d-495b-bcac-9d65ef5f0c7a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:56.242517 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:56.243550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:56.243902 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:56.244252 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] PATH_INFO: `/v3/projects/2ebe5da3ff5d439b81dee5e6bb8bb838` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:56.245560 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebe5da3ff5d439b81dee5e6bb8bb838)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:56.248051 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:56.297242 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebe5da3ff5d439b81dee5e6bb8bb838', 'request_id': 'req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.306653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebe5da3ff5d439b81dee5e6bb8bb838', 'request_id': 'req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.313324 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebe5da3ff5d439b81dee5e6bb8bb838', 'request_id': 'req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.323745 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] The token cache is being invalidate because project 2ebe5da3ff5d439b81dee5e6bb8bb838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:56.324032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.324711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5d6ea0a-ab97-4b2d-94af-867de2d27f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.326546 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1347/2716] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:56 2022] DELETE /identity/v3/projects/2ebe5da3ff5d439b81dee5e6bb8bb838 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:56.330483 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:56.340717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acf4b-ad6e-4048-b5a0-4a0aa6d450a4 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:56.386427 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:56.386708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:56.386978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:56.402697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:56.403580 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:56.403861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:56.404119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] PATH_INFO: `/v3/users/8d34edc1b03c4e2eae0f782380340b65` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:56.405389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d34edc1b03c4e2eae0f782380340b65)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:56.406191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] MFA Rules not processed for user `f9dfd20af1874415be353e22a59ecbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:56.407405 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:56.407531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:56.455684 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d34edc1b03c4e2eae0f782380340b65'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.462484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d34edc1b03c4e2eae0f782380340b65'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.464156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1348/2717] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:56.474690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d34edc1b03c4e2eae0f782380340b65'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.482141 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d34edc1b03c4e2eae0f782380340b65'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.482823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d34edc1b03c4e2eae0f782380340b65'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.488880 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1370/2718] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:21:56 2022] DELETE /identity/v3/users/8d34edc1b03c4e2eae0f782380340b65 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:56.758375 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:56.760074 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:56.779458 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6da927-1f69-4966-9367-b5c71174fc41 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:56.790526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:56.792125 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:56.838389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:56.839260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:56.839536 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:56.839802 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] PATH_INFO: `/v3/projects/47982b79746d4b78a7aeee7236b42cb1` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:56.844812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47982b79746d4b78a7aeee7236b42cb1)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:56.847927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:56.850447 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5bd6-148f-40c4-9294-37c7c7c8d4ed admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:56.855068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:56.855806 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:56.856092 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:56.856481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:56.858545 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:56.868653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:56.870139 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6da6aa-24cb-4b9a-886f-be65c90bf955 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:56.878659 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1371/2719] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:21:56.895849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47982b79746d4b78a7aeee7236b42cb1', 'request_id': 'req-003c0e10-6d1e-4292-85ca-da05da35f55e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.904447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47982b79746d4b78a7aeee7236b42cb1', 'request_id': 'req-003c0e10-6d1e-4292-85ca-da05da35f55e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.911360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47982b79746d4b78a7aeee7236b42cb1', 'request_id': 'req-003c0e10-6d1e-4292-85ca-da05da35f55e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.921572 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] The token cache is being invalidate because project 47982b79746d4b78a7aeee7236b42cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:21:56.922297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.922960 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-003c0e10-6d1e-4292-85ca-da05da35f55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:21:56.924608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1349/2720] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:21:56 2022] DELETE /identity/v3/projects/47982b79746d4b78a7aeee7236b42cb1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:56.929792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:56.930067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:56.930367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:56.948058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:56.949284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:57.008532 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1372/2721] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:57.016263 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.016545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.016815 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.035101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:57.036306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:57.044182 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1350/2722] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:57.048422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.058409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd452f-035b-4d36-8c12-d563607d749d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.063158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.063822 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.064121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.064380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.065146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:21:57.065542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.067155 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.082503 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1373/2723] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:21:57.085017 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.094617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471bd0d-c31a-444c-9590-53e6bfee0259 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.100186 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.100883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.101205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.101479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.102185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.104096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.131537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1351/2724] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:57.136282 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.146214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b26e4-b0a6-48ec-81cf-26af1df2029d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.201644 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.202338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.202619 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.202890 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.203614 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.205604 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.226826 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1374/2725] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:21:57.231078 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.241675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3ff60-e0a7-49cb-af86-07913f97dfb1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.246708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.247524 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.247848 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.248118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.248880 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.250606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.262136 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1352/2726] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:57.266264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.276957 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc09fd9-62bb-4e96-bfff-222434504a60 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.281921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.282595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.282877 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.283150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.283881 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.285980 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.299272 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1375/2727] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:57.300674 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.314708 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16184bfe-c17f-450b-a8c4-921ccff57570 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.321266 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c67f8-5cbf-4d51-b044-a9196c5f531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.322473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c67f8-5cbf-4d51-b044-a9196c5f531d admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.322756 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c67f8-5cbf-4d51-b044-a9196c5f531d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.323030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c67f8-5cbf-4d51-b044-a9196c5f531d admin admin] PATH_INFO: `/v3/projects/69953be9da584ce78cae51277b0f3bad/users/862ca8db52f1433f9da2c7d341d8318c/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.337284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.339264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:57.340083 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c67f8-5cbf-4d51-b044-a9196c5f531d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69953be9da584ce78cae51277b0f3bad, user_id=862ca8db52f1433f9da2c7d341d8318c, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.343110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c67f8-5cbf-4d51-b044-a9196c5f531d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.360046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1353/2728] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:57 2022] PUT /identity/v3/projects/69953be9da584ce78cae51277b0f3bad/users/862ca8db52f1433f9da2c7d341d8318c/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:21:57.371098 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.371550 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.372391 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.402453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] MFA Rules not processed for user `862ca8db52f1433f9da2c7d341d8318c`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:57.403670 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:57.418143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120d4a1-f937-4431-96ba-cd5308e4f267 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.467682 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1354/2729] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:21:57.472820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.479165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.479859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.480106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.480373 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.482254 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:57.494441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.496048 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.507988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1376/2730] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:21:57.541564 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97f47-7117-4243-a4ca-beb6844c28bf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.547021 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.547692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.547972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.548248 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.548973 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.550943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.581092 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1355/2731] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:57.584536 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.594927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9ddc9-6834-44af-9bee-1a2e49e66016 service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.651938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.652617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.652915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.653190 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.653879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.655828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.679706 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1377/2732] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:57.681108 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.691720 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3c14-eb9e-4442-859b-b21d7d122801 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.696400 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.697097 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.697377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.697650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.698382 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.699968 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.710792 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1356/2733] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:21:57.715006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.725278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20b113-064a-4223-8d56-2e4eabcbb964 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.731812 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909f521-ebc9-449f-a932-197c50bab23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.733071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f521-ebc9-449f-a932-197c50bab23f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.733651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f521-ebc9-449f-a932-197c50bab23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.734186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f521-ebc9-449f-a932-197c50bab23f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.735647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909f521-ebc9-449f-a932-197c50bab23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.738938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909f521-ebc9-449f-a932-197c50bab23f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.755475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1378/2734] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:57.760786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.771483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562ef66-0f59-4b26-8d56-1049206478ae admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.776185 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:57.777430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.777430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.777641 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] PATH_INFO: `/v3/projects/cffb5c12cdec435a8dd156e83699a165/users/d3f483ee25c64cff8338a0bf2d46cd69/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.794609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb5c12cdec435a8dd156e83699a165, user_id=d3f483ee25c64cff8338a0bf2d46cd69, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:57.798121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:57.815033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1357/2735] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:57 2022] PUT /identity/v3/projects/cffb5c12cdec435a8dd156e83699a165/users/d3f483ee25c64cff8338a0bf2d46cd69/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:57.826243 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:57.826774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:57.826774 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:57.855089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] MFA Rules not processed for user `d3f483ee25c64cff8338a0bf2d46cd69`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:57.856364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:57.925808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1379/2736] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:57.930412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:57.995139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305f03f-87d4-4b87-9949-c3603ebbbd3e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:57.999995 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.000664 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.000967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.001243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.002050 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.004128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.031786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1358/2737] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:21:57 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:58.035940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:58.048722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610b84-c8b4-439a-993a-43d64cb9658d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:58.110419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.111223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.111565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.111840 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.112696 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.114942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.136839 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1380/2738] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:21:58 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:21:58.140890 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:58.151687 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7ee5-c781-441e-acb7-dea411d6d50d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:58.156361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.157171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.157454 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.157754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.158526 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.160530 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.171140 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1359/2739] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:58.175418 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:58.185935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28c2a0-0516-4349-b8cb-6b2b243b42b5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:58.191445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.192324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.192597 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.192865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] PATH_INFO: `/v3/projects/1b89fa9420be4dfb9ac73b61cff1e0d3/users/8799a4a562be41aa897fd26053d8462b/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.208489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b89fa9420be4dfb9ac73b61cff1e0d3, user_id=8799a4a562be41aa897fd26053d8462b, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.211160 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.225721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1381/2740] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:58 2022] PUT /identity/v3/projects/1b89fa9420be4dfb9ac73b61cff1e0d3/users/8799a4a562be41aa897fd26053d8462b/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:58.229763 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:58.245868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac338017-86f0-422a-9c53-52569cdbf77a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:58.314775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3d56-a73b-4935-bc47-cf6d00601142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.315634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3d56-a73b-4935-bc47-cf6d00601142 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.316043 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3d56-a73b-4935-bc47-cf6d00601142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.316325 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3d56-a73b-4935-bc47-cf6d00601142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.317091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3d56-a73b-4935-bc47-cf6d00601142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.318717 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3d56-a73b-4935-bc47-cf6d00601142 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.330022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1360/2741] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:21:58.335027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:58.346590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73424-4865-49bc-8e75-4f2bbeacbf02 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:58.351555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.352475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.352783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.353063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] PATH_INFO: `/v3/projects/1b89fa9420be4dfb9ac73b61cff1e0d3/users/8799a4a562be41aa897fd26053d8462b/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.355151 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b89fa9420be4dfb9ac73b61cff1e0d3, user_id=8799a4a562be41aa897fd26053d8462b, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.357821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.369920 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1382/2742] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:21:58 2022] PUT /identity/v3/projects/1b89fa9420be4dfb9ac73b61cff1e0d3/users/8799a4a562be41aa897fd26053d8462b/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:21:58.381754 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.382155 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.382801 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.411936 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] MFA Rules not processed for user `8799a4a562be41aa897fd26053d8462b`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:21:58.413191 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:58.490418 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1361/2743] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:21:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:21:58.503518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:21:58.505395 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:21:58.573007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6744-7e63-4400-a9da-0862c72f4edf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:21:58.576838 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:21:58.577584 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:21:58.577863 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:21:58.578129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:21:58.637846 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:21:58.639341 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:21:58.649317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1383/2744] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:21:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:00.163428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:00.164549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:00.177412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3f22-2eea-4108-abd9-a2298f8b3a1c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:00.181229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:00.182214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:00.182692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:00.183207 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:00.244094 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:00.245609 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:00.255358 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1362/2745] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:00.777991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:00.787494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f69a07-e527-4526-8c52-db576dcf676b service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:00.791581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416ddf4-a669-48de-9f30-c06405bad7b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:00.792241 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416ddf4-a669-48de-9f30-c06405bad7b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:00.792517 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416ddf4-a669-48de-9f30-c06405bad7b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:00.792785 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416ddf4-a669-48de-9f30-c06405bad7b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:00.803297 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416ddf4-a669-48de-9f30-c06405bad7b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:00.804744 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416ddf4-a669-48de-9f30-c06405bad7b5 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:00.814919 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1384/2746] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:04.729128 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:04.806538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612557d8-cc53-41a0-9066-833b45520234 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:04.812656 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:04.813584 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:04.813857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:04.814120 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] PATH_INFO: `/v3/users/862ca8db52f1433f9da2c7d341d8318c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:04.815504 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=862ca8db52f1433f9da2c7d341d8318c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:04.817479 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:04.869927 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862ca8db52f1433f9da2c7d341d8318c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:04.876545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862ca8db52f1433f9da2c7d341d8318c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:04.885500 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862ca8db52f1433f9da2c7d341d8318c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:04.886123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862ca8db52f1433f9da2c7d341d8318c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:04.886779 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862ca8db52f1433f9da2c7d341d8318c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:04.903510 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1363/2747] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:04 2022] DELETE /identity/v3/users/862ca8db52f1433f9da2c7d341d8318c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:04.908935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:04.909400 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:04.909494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:04.928411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:04.929650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:04.992663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1385/2748] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:05.002843 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:05.004344 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:05.062368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88898e-4bb5-4992-9e82-7405fc38b11e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:05.067371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:05.068016 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:05.068290 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:05.068557 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:05.080487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:05.082825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:05.093434 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1364/2749] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:05.360729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:05.362223 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:05.375709 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5662396-1d4b-4a58-8b5c-4ebfe581cea3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:05.381233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:05.382177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:05.382788 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:05.383065 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] PATH_INFO: `/v3/projects/69953be9da584ce78cae51277b0f3bad` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:05.384321 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69953be9da584ce78cae51277b0f3bad)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:05.386460 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:05.435381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69953be9da584ce78cae51277b0f3bad', 'request_id': 'req-6aaf5f58-a494-44cc-b269-fbca3f7c8727'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.444260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69953be9da584ce78cae51277b0f3bad', 'request_id': 'req-6aaf5f58-a494-44cc-b269-fbca3f7c8727'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.452745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69953be9da584ce78cae51277b0f3bad', 'request_id': 'req-6aaf5f58-a494-44cc-b269-fbca3f7c8727'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.470356 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] The token cache is being invalidate because project 69953be9da584ce78cae51277b0f3bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:05.470752 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.471575 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.473953 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1386/2750] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:05 2022] DELETE /identity/v3/projects/69953be9da584ce78cae51277b0f3bad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:05.478397 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:05.488259 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6069d1-249f-4080-8d23-0f397e280e74 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:05.549275 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:05.550172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:05.550453 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:05.550724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] PATH_INFO: `/v3/users/d3f483ee25c64cff8338a0bf2d46cd69` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:05.552273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f483ee25c64cff8338a0bf2d46cd69)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:05.554297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:05.606145 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f483ee25c64cff8338a0bf2d46cd69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.613508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f483ee25c64cff8338a0bf2d46cd69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.623476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f483ee25c64cff8338a0bf2d46cd69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.624295 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f483ee25c64cff8338a0bf2d46cd69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.624949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f483ee25c64cff8338a0bf2d46cd69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:05.642677 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1365/2751] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:05 2022] DELETE /identity/v3/users/d3f483ee25c64cff8338a0bf2d46cd69 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:22:05.973689 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:05.975787 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:05.990907 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf5f58-a494-44cc-b269-fbca3f7c8727 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:06.052626 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:06.053526 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.053802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.054069 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] PATH_INFO: `/v3/projects/cffb5c12cdec435a8dd156e83699a165` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.055249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffb5c12cdec435a8dd156e83699a165)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:06.057228 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:06.104514 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffb5c12cdec435a8dd156e83699a165', 'request_id': 'req-ca8e2954-151d-43a1-a42c-44c78c5f2f96'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.113484 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffb5c12cdec435a8dd156e83699a165', 'request_id': 'req-ca8e2954-151d-43a1-a42c-44c78c5f2f96'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.119845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffb5c12cdec435a8dd156e83699a165', 'request_id': 'req-ca8e2954-151d-43a1-a42c-44c78c5f2f96'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.131437 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] The token cache is being invalidate because project cffb5c12cdec435a8dd156e83699a165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:06.131719 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.132792 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.134388 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1387/2752] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:05 2022] DELETE /identity/v3/projects/cffb5c12cdec435a8dd156e83699a165 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:06.138619 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:06.140224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:06.153534 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ce16-46c7-4678-a569-a84bf4449027 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:06.212514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:06.213444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.213724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.213994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] PATH_INFO: `/v3/users/8799a4a562be41aa897fd26053d8462b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.215273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8799a4a562be41aa897fd26053d8462b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:06.217217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:06.267361 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8799a4a562be41aa897fd26053d8462b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.274280 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8799a4a562be41aa897fd26053d8462b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.283481 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8799a4a562be41aa897fd26053d8462b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.284147 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8799a4a562be41aa897fd26053d8462b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.284808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-46da1eb9-01ac-4bef-a405-35fdd1d8beb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8799a4a562be41aa897fd26053d8462b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.301842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1366/2753] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:06 2022] DELETE /identity/v3/users/8799a4a562be41aa897fd26053d8462b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:06.607556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:06.609194 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:06.622080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e2954-151d-43a1-a42c-44c78c5f2f96 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:06.678745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:06.679531 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.679809 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.680079 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] PATH_INFO: `/v3/projects/1b89fa9420be4dfb9ac73b61cff1e0d3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.681312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b89fa9420be4dfb9ac73b61cff1e0d3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:06.683213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:06.729344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b89fa9420be4dfb9ac73b61cff1e0d3', 'request_id': 'req-66b120c0-1cea-4ee8-a08e-4eed5909c452'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.737736 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b89fa9420be4dfb9ac73b61cff1e0d3', 'request_id': 'req-66b120c0-1cea-4ee8-a08e-4eed5909c452'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.743329 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b89fa9420be4dfb9ac73b61cff1e0d3', 'request_id': 'req-66b120c0-1cea-4ee8-a08e-4eed5909c452'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.754565 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] The token cache is being invalidate because project 1b89fa9420be4dfb9ac73b61cff1e0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:06.754911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.755663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-66b120c0-1cea-4ee8-a08e-4eed5909c452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:06.757352 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1388/2754] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:06 2022] DELETE /identity/v3/projects/1b89fa9420be4dfb9ac73b61cff1e0d3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:06.763042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.763341 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.763618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.783114 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:06.784289 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:06.846827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1367/2755] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:06.856595 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.856859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.857205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.876009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:06.877227 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:06.886134 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1389/2756] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:06.890922 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:06.905892 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bd21b-5d65-4a8b-aacd-994fa609536d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:06.913523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:06.914174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.914448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.914715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.915428 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:22:06.915728 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:06.917346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:06.929376 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1368/2757] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:22:06.933869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:06.943493 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8e62f-4ac7-4444-b8d6-7fd30dcd0e25 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:06.948547 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:06.949216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:06.949599 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:06.949873 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:06.950559 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:06.952446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:06.981653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1390/2758] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:22:06.985904 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:06.995727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc0506-c462-48a4-aba8-ec7338bbbb3e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:07.052066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:07.053087 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:07.053373 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:07.053650 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:07.054415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:07.056337 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:07.080398 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1369/2759] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:06 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:07.084869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:07.096292 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f97891-e46f-4997-ad34-17f36413f803 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:07.102793 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:07.103732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:07.104278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:07.105036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:07.105671 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:07.107260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:07.120068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1391/2760] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:07.126304 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:07.139028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83746-4d80-43fd-9bae-da24a0a5ad36 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:07.143770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12eaf-0924-4e25-af08-0cb3386cb08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:07.144432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12eaf-0924-4e25-af08-0cb3386cb08a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:07.144705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12eaf-0924-4e25-af08-0cb3386cb08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:07.144965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12eaf-0924-4e25-af08-0cb3386cb08a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:07.145942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd12eaf-0924-4e25-af08-0cb3386cb08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:07.147617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd12eaf-0924-4e25-af08-0cb3386cb08a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:07.161450 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1370/2761] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:07.162976 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:07.172943 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2f779-5c02-46e3-a44b-b4c06f4b76c2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:07.178161 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:07.179046 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:07.179319 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:07.179642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] PATH_INFO: `/v3/projects/9ff00fa7f72d4523b6d26ddda865bbcf/users/b524e1039aef4893bc4cf03ef97b4cdd/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:07.194518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff00fa7f72d4523b6d26ddda865bbcf, user_id=b524e1039aef4893bc4cf03ef97b4cdd, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:07.197182 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:07.212666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1392/2762] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:07 2022] PUT /identity/v3/projects/9ff00fa7f72d4523b6d26ddda865bbcf/users/b524e1039aef4893bc4cf03ef97b4cdd/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:22:07.217736 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:07.218029 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:07.218342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:07.236852 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:07.238093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:07.299068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1371/2763] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:07.309344 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:07.311177 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:07.372001 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b026b5-aaac-42d2-ba1a-fe0be868207b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:07.375869 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9d4c0-77b2-414c-b84f-a79e3b908133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:07.376495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d4c0-77b2-414c-b84f-a79e3b908133 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:07.376810 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d4c0-77b2-414c-b84f-a79e3b908133 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:07.377114 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9d4c0-77b2-414c-b84f-a79e3b908133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:07.386921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9d4c0-77b2-414c-b84f-a79e3b908133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:07.388453 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9d4c0-77b2-414c-b84f-a79e3b908133 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:07.398338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1393/2764] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:22:12.314653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:12.316131 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:12.422519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcabb9f-67a6-40b7-a1d6-0739505363ae None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:12.436538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:12.437247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:12.437700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:12.438127 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:12.440595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:12.454368 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:12.456118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:12.467203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1372/2765] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:13.261311 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.261762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.261855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.304888 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] MFA Rules not processed for user `b524e1039aef4893bc4cf03ef97b4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:13.306236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:13.395541 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1394/2766] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:13.400264 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:13.414709 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416057a-e6fa-4760-b552-4d6b485c69f6 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:13.421820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:13.422541 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.422830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.423122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.424868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:13.427320 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:13.469859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1373/2767] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:13 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:22:13.471765 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:13.485383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92f8a8-6f71-4d60-8332-f49840e76c82 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:13.580828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:13.581590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.581872 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.582143 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.583089 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:13.585309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:13.637449 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1395/2768] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:13 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:13.642205 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:13.657107 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdcf22-888f-42c7-a60d-00fb514749ae admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:13.664388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:13.665707 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.666447 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.666941 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.667961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:13.670023 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:13.690095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1374/2769] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:22:13.694928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:13.711111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f55a29-6903-4d82-b431-0b51319b84ed admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:13.738605 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:13.740837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.741260 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.741640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] PATH_INFO: `/v3/projects/12a4659336394c38b35c1d410e48e51a/users/1473ec693c424f958d607b8c66706889/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.764376 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a4659336394c38b35c1d410e48e51a, user_id=1473ec693c424f958d607b8c66706889, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:13.767542 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:13.802112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1396/2770] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:13 2022] PUT /identity/v3/projects/12a4659336394c38b35c1d410e48e51a/users/1473ec693c424f958d607b8c66706889/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:13.807473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:13.814190 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbefd5-c972-4676-bdca-a4941c60fd4c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:13.890381 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:13.891068 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.891339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.891618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.892334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:13.893974 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:13.909260 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1375/2771] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 04 06:22:13.913320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:13.924086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f311f-f45f-4540-b6a0-f7e696398796 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:13.930199 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdd576-1954-4604-974b-1603015a23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:13.931101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd576-1954-4604-974b-1603015a23f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:13.931393 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd576-1954-4604-974b-1603015a23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:13.931650 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd576-1954-4604-974b-1603015a23f9 admin admin] PATH_INFO: `/v3/projects/12a4659336394c38b35c1d410e48e51a/users/1473ec693c424f958d607b8c66706889/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:13.933747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdd576-1954-4604-974b-1603015a23f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a4659336394c38b35c1d410e48e51a, user_id=1473ec693c424f958d607b8c66706889, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:13.937350 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdd576-1954-4604-974b-1603015a23f9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:13.954159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1397/2772] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:13 2022] PUT /identity/v3/projects/12a4659336394c38b35c1d410e48e51a/users/1473ec693c424f958d607b8c66706889/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:22:15.907833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:15.911054 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:16.029733 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d66437-3c66-43fa-a1df-5d85885e4c4f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:16.119334 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:16.120022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:16.120305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:16.121192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:16.123626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:16.216396 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:16.218405 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:16.233124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1376/2773] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:19.574419 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:19.574917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:19.575031 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:19.614077 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] MFA Rules not processed for user `1473ec693c424f958d607b8c66706889`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:19.615927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:19.699538 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1398/2774] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:19.715130 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:19.716797 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:19.784783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3b6f-a8da-48be-9138-bea1b4a81253 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:19.789867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0327-6750-4ae7-9971-71dfd5c7b101 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e1cdcbf35ed49a1b130757f7230e5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:19.793949 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0327-6750-4ae7-9971-71dfd5c7b101 service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:19.794299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0327-6750-4ae7-9971-71dfd5c7b101 service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:19.794645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0327-6750-4ae7-9971-71dfd5c7b101 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:19.860463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0327-6750-4ae7-9971-71dfd5c7b101 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:19.862123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0327-6750-4ae7-9971-71dfd5c7b101 service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:19.875101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1377/2775] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:19.940347 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:19.951715 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164ec57-c3d5-4c65-ba1c-a2126df8a300 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:19.955940 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:19.956592 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:19.956868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:19.957175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:19.959324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:20.013700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:20.013982 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:20.014254 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:20.036330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:20.037589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:20.043512 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:20.045150 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:20.058927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1399/2776] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:20.108015 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1378/2777] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:22:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:20.166063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:20.167947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:20.247392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a156-5ad7-4152-84ea-750a690f9dff service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:20.255163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:20.256083 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:20.256367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:20.256649 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:20.266520 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:20.268170 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:20.278495 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1400/2778] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:22:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:22:24.521505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:24.524336 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:24.560833 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169acad-11e0-49e1-aef7-eb0bede0d151 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:24.577168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:24.578224 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:24.578645 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:24.579154 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] PATH_INFO: `/v3/users/cea36666ab2947d8bf2a6abbc197be7f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:24.609821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea36666ab2947d8bf2a6abbc197be7f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:24.612052 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:24.673188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea36666ab2947d8bf2a6abbc197be7f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:24.680691 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea36666ab2947d8bf2a6abbc197be7f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:24.691649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea36666ab2947d8bf2a6abbc197be7f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:24.693256 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea36666ab2947d8bf2a6abbc197be7f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:24.694118 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-91513394-f60e-4344-93f1-8ff07d5ec928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea36666ab2947d8bf2a6abbc197be7f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:24.715345 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1379/2779] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:24 2022] DELETE /identity/v3/users/cea36666ab2947d8bf2a6abbc197be7f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:24.976312 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:24.991698 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a3b0-dd6d-49cc-a5e2-c286f72d6559 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.077800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.078925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.079353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.079773 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] PATH_INFO: `/v3/projects/a97a33a2aa5b45e28ce2fbc14234447a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.091970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97a33a2aa5b45e28ce2fbc14234447a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.094465 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.146406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97a33a2aa5b45e28ce2fbc14234447a', 'request_id': 'req-2c84ec0d-8b41-48e0-843c-3c668380f0ab'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:25.154830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97a33a2aa5b45e28ce2fbc14234447a', 'request_id': 'req-2c84ec0d-8b41-48e0-843c-3c668380f0ab'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:25.160557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97a33a2aa5b45e28ce2fbc14234447a', 'request_id': 'req-2c84ec0d-8b41-48e0-843c-3c668380f0ab'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:25.174768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] The token cache is being invalidate because project a97a33a2aa5b45e28ce2fbc14234447a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:25.174768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:25.175480 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2c84ec0d-8b41-48e0-843c-3c668380f0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:25.181033 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1401/2780] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:24 2022] DELETE /identity/v3/projects/a97a33a2aa5b45e28ce2fbc14234447a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:25.183124 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.183528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.183930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.208622 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:25.211998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:25.278752 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1380/2781] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:25.287086 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.287381 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.287655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.307501 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:25.308717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:25.320782 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1402/2782] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:25.321652 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.332159 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f90dd1-62be-468e-a0ce-da5ba4313f73 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.339961 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.340669 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.341066 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.341249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.341986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:22:25.342297 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.343916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.359027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1381/2783] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:22:25.363087 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.374708 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcc845-0c57-4c02-8dbb-4c8b20b8f95d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.379842 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.381240 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.381622 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.381990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.383111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.385107 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.421422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1403/2784] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:25 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:25.422923 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.435886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d951-0a0c-412f-9913-cd644df1ad6a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.502676 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.503446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.503791 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.504156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.504987 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.507032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.556144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1382/2785] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:25 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:22:25.560271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.573726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae234a-588d-412b-bbbc-66bf7b704da1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.579634 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.580657 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.581360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.581879 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.583158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.586794 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.599317 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1404/2786] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:25.603392 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.615262 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d6fa6-f394-4af9-9828-0f25e20c36be admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.620705 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da662d9-878b-431d-bc53-0304eef7f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.621431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da662d9-878b-431d-bc53-0304eef7f302 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.621711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da662d9-878b-431d-bc53-0304eef7f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.622137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da662d9-878b-431d-bc53-0304eef7f302 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.623082 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da662d9-878b-431d-bc53-0304eef7f302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.624493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da662d9-878b-431d-bc53-0304eef7f302 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.637033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1383/2787] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:25.641633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.677594 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c93eb-1f56-47dd-8519-f7dea7a8788f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.685507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.686762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.686762 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.687159 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] PATH_INFO: `/v3/projects/f646d1a989a043f7a75a03a6d85e7e0d/users/340c7c38f2824af1b73dfb78a00ace08/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.705651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f646d1a989a043f7a75a03a6d85e7e0d, user_id=340c7c38f2824af1b73dfb78a00ace08, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.708448 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:25.730153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1405/2788] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:25 2022] PUT /identity/v3/projects/f646d1a989a043f7a75a03a6d85e7e0d/users/340c7c38f2824af1b73dfb78a00ace08/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:25.740369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.740751 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.741355 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.782693 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] MFA Rules not processed for user `340c7c38f2824af1b73dfb78a00ace08`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:25.783924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:25.892696 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1384/2789] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:25.897396 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:25.964638 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115b9aa-72fa-4fd8-89cb-f3c0c9d3942a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:25.969416 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:25.970074 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:25.970353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:25.970623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:25.972716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:25.975132 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.009600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1406/2790] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:25 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:26.010846 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:26.022086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ff4ba-560c-4895-87a2-e6e5aa65b6ea None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:26.109867 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:26.110605 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.110889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.111157 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.111849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:26.114065 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.154845 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1385/2791] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:26 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:26.160844 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:26.177440 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89327-06f9-4042-8f20-b32e726c5b3b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:26.195411 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:26.196109 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.196392 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.196663 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.197442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:26.201295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.215567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1407/2792] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:26.219505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:26.233967 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871242b6-717e-48c6-8040-7383bd013e3b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:26.239800 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:26.240836 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.243270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.243270 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] PATH_INFO: `/v3/projects/7b16e020f89a48ed8c257b93e39150a5/users/09b11379372d486289ef67dce248cc90/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.262834 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b16e020f89a48ed8c257b93e39150a5, user_id=09b11379372d486289ef67dce248cc90, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:26.265623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.288255 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1386/2793] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:26 2022] PUT /identity/v3/projects/7b16e020f89a48ed8c257b93e39150a5/users/09b11379372d486289ef67dce248cc90/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:26.289841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:26.301631 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19404-95a5-4bb5-889c-73737b7900bf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:26.382163 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12723ee-5616-469a-af6d-6d6841478ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:26.383099 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12723ee-5616-469a-af6d-6d6841478ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.383379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12723ee-5616-469a-af6d-6d6841478ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.383652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12723ee-5616-469a-af6d-6d6841478ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.384390 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12723ee-5616-469a-af6d-6d6841478ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:26.386206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12723ee-5616-469a-af6d-6d6841478ac6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.398854 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1408/2794] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:26.403122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:26.416462 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b45ca-ebe6-4039-befa-5d78532e7e3a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:26.423210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:26.423210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.423210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.423210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] PATH_INFO: `/v3/projects/7b16e020f89a48ed8c257b93e39150a5/users/09b11379372d486289ef67dce248cc90/roles/5fd8ee302a3344489bda8c045d41beba` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.424811 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b16e020f89a48ed8c257b93e39150a5, user_id=09b11379372d486289ef67dce248cc90, role_id=5fd8ee302a3344489bda8c045d41beba)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:26.428363 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.440623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1387/2795] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:26 2022] PUT /identity/v3/projects/7b16e020f89a48ed8c257b93e39150a5/users/09b11379372d486289ef67dce248cc90/roles/5fd8ee302a3344489bda8c045d41beba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:26.452175 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.452457 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.452735 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.491413 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] MFA Rules not processed for user `09b11379372d486289ef67dce248cc90`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:26.492892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:26.572655 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1409/2796] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:26.584887 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:26.587338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:26.661565 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b21aa2-2ac2-4212-84ac-37440d0e1961 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:26.665991 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0b801-7652-4d78-ad9e-dfb803ef6f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:26.666679 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b801-7652-4d78-ad9e-dfb803ef6f2d service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:26.666958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b801-7652-4d78-ad9e-dfb803ef6f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:26.667229 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b801-7652-4d78-ad9e-dfb803ef6f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:26.681972 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b801-7652-4d78-ad9e-dfb803ef6f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:26.683988 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b801-7652-4d78-ad9e-dfb803ef6f2d service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:26.695314 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1388/2797] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:27.142271 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:27.236767 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66929e5-e74c-4a54-a2ae-11a9e35b7149 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:27.242115 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:27.243007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:27.243286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:27.243556 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] PATH_INFO: `/v3/users/340c7c38f2824af1b73dfb78a00ace08` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:27.244779 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] RBAC: Authorizing `identity:delete_user(user_id=340c7c38f2824af1b73dfb78a00ace08)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:27.246763 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:27.328973 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340c7c38f2824af1b73dfb78a00ace08'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:27.336591 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340c7c38f2824af1b73dfb78a00ace08'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:27.350927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340c7c38f2824af1b73dfb78a00ace08'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:27.359815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340c7c38f2824af1b73dfb78a00ace08'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:27.360430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340c7c38f2824af1b73dfb78a00ace08'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:27.367875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1410/2798] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:27 2022] DELETE /identity/v3/users/340c7c38f2824af1b73dfb78a00ace08 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:27.372424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:27.372711 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:27.373045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:27.397648 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:27.399232 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:27.479292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1389/2799] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:27.486524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:27.488173 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:27.556745 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d5c0-6fc7-4eb0-8df5-0891fe21455b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:27.560394 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:27.561214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:27.561498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:27.561769 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:27.573052 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:27.574509 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:27.593970 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1411/2800] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:27.910298 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:27.912177 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:27.924566 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6204e5-7094-448a-9efe-d59d44a24ffa None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:27.930421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:27.931321 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:27.931589 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:27.931863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] PATH_INFO: `/v3/projects/f646d1a989a043f7a75a03a6d85e7e0d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:27.933091 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f646d1a989a043f7a75a03a6d85e7e0d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:27.935166 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:27.996821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f646d1a989a043f7a75a03a6d85e7e0d', 'request_id': 'req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.004875 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f646d1a989a043f7a75a03a6d85e7e0d', 'request_id': 'req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.012406 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f646d1a989a043f7a75a03a6d85e7e0d', 'request_id': 'req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.024079 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] The token cache is being invalidate because project f646d1a989a043f7a75a03a6d85e7e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:28.024362 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.025046 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.026591 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1390/2801] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:27 2022] DELETE /identity/v3/projects/f646d1a989a043f7a75a03a6d85e7e0d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:28.031023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:28.040942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce85b3-3a81-4773-86af-e841650b6db8 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:28.125945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:28.126855 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:28.127129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:28.127422 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] PATH_INFO: `/v3/users/09b11379372d486289ef67dce248cc90` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:28.128647 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b11379372d486289ef67dce248cc90)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:28.130831 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:28.185677 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b11379372d486289ef67dce248cc90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.194865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b11379372d486289ef67dce248cc90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.207191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b11379372d486289ef67dce248cc90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.218546 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b11379372d486289ef67dce248cc90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.220811 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2ec27aa7-398b-4585-a784-39987d2cf031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b11379372d486289ef67dce248cc90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.230481 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1412/2802] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:28 2022] DELETE /identity/v3/users/09b11379372d486289ef67dce248cc90 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:28.544410 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:28.545943 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:28.560804 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61e4c-2876-4253-a7fa-aaf7900e8ca8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:28.643305 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:28.644402 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:28.644753 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:28.645146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] PATH_INFO: `/v3/projects/7b16e020f89a48ed8c257b93e39150a5` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:28.646424 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b16e020f89a48ed8c257b93e39150a5)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:28.648421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:28.709490 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b16e020f89a48ed8c257b93e39150a5', 'request_id': 'req-20d66a98-fbf6-410b-9b00-0481419e5cfe'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.720482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b16e020f89a48ed8c257b93e39150a5', 'request_id': 'req-20d66a98-fbf6-410b-9b00-0481419e5cfe'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.730778 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b16e020f89a48ed8c257b93e39150a5', 'request_id': 'req-20d66a98-fbf6-410b-9b00-0481419e5cfe'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.747168 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] The token cache is being invalidate because project 7b16e020f89a48ed8c257b93e39150a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:28.747460 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.748214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20d66a98-fbf6-410b-9b00-0481419e5cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:28.755445 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:28.755732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:28.756010 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:28.757489 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1391/2803] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:28 2022] DELETE /identity/v3/projects/7b16e020f89a48ed8c257b93e39150a5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:28.775656 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:28.777022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:28.846032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1413/2804] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:28.854203 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:28.855247 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:28.855994 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:28.878204 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:28.880061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:28.888675 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1392/2805] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:28.895820 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:28.905865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bceb723-ad4a-40ee-9c8e-649c1c7b0b0f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:28.913073 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:28.913761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:28.914042 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:28.914315 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:28.915054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:22:28.915360 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:28.917003 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:28.930364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1414/2806] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:22:28.934538 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:28.944217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24173465-9c77-4204-8608-b1ca5cd0f0b5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:28.951377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:28.952061 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:28.952452 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:28.952725 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:28.953461 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:28.955366 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:28.990926 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1393/2807] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:28 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 04 06:22:28.995245 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:29.006324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dada1-87e1-461a-9410-17817118d9d5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:29.069013 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:29.069990 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:29.070265 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:29.070535 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:29.071363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:29.073375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:29.099363 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1415/2808] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:28 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:29.103515 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:29.126939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868818b-8bfc-46e2-9f94-77a63bb2d73c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:29.132162 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:29.133340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:29.133689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:29.133959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:29.134688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:29.136476 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:29.147882 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1394/2809] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:29.151993 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:29.166747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa735c4-944b-4e8f-b713-d56e2f7a8cdb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:29.171726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef1c75-3101-4194-8f61-d67727e87708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:29.172477 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef1c75-3101-4194-8f61-d67727e87708 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:29.172828 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef1c75-3101-4194-8f61-d67727e87708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:29.173216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef1c75-3101-4194-8f61-d67727e87708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:29.174084 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef1c75-3101-4194-8f61-d67727e87708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:29.176867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef1c75-3101-4194-8f61-d67727e87708 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:29.188047 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1416/2810] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:29.192575 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:29.203692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d204c-5bf4-48fa-a635-e23ae569e2db admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:29.208737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:29.209734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:29.210086 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:29.210700 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] PATH_INFO: `/v3/projects/e2ec3d4c8c9a43bf8ac734caff755c5e/users/1c45060fb3fb4e5eb35305bdc8b737a8/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:29.227555 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ec3d4c8c9a43bf8ac734caff755c5e, user_id=1c45060fb3fb4e5eb35305bdc8b737a8, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:29.230389 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:29.247883 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1395/2811] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:29 2022] PUT /identity/v3/projects/e2ec3d4c8c9a43bf8ac734caff755c5e/users/1c45060fb3fb4e5eb35305bdc8b737a8/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:29.258766 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ab9ce-a215-4a7a-b441-25dc96380ead None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:29.259054 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ab9ce-a215-4a7a-b441-25dc96380ead None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:29.259331 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ab9ce-a215-4a7a-b441-25dc96380ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:29.292436 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8d4ab9ce-a215-4a7a-b441-25dc96380ead None None] MFA Rules not processed for user `1c45060fb3fb4e5eb35305bdc8b737a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:29.293927 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8d4ab9ce-a215-4a7a-b441-25dc96380ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:29.375041 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1417/2812] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:29.387150 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:29.389612 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:29.452601 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e012d-7804-43a2-927b-467e3b97116b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:29.456309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb43cb-a536-4041-90d3-15773aeb19c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:29.457007 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb43cb-a536-4041-90d3-15773aeb19c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:29.457286 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb43cb-a536-4041-90d3-15773aeb19c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:29.457563 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb43cb-a536-4041-90d3-15773aeb19c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:29.467064 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb43cb-a536-4041-90d3-15773aeb19c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:29.468528 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb43cb-a536-4041-90d3-15773aeb19c4 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:29.480343 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1396/2813] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:30.517058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46148dd-0534-4481-ba7b-026292873621 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:30.517572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46148dd-0534-4481-ba7b-026292873621 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:30.517572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46148dd-0534-4481-ba7b-026292873621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:30.535623 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d46148dd-0534-4481-ba7b-026292873621 None None] MFA Rules not processed for user `b524e1039aef4893bc4cf03ef97b4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:30.536841 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d46148dd-0534-4481-ba7b-026292873621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:30.592111 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1418/2814] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:35.405588 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:35.406105 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:35.406210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:35.424387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:35.425724 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:35.481523 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1397/2815] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:22:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:35.497119 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46148dd-0534-4481-ba7b-026292873621 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:35.498776 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d46148dd-0534-4481-ba7b-026292873621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:35.580016 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46148dd-0534-4481-ba7b-026292873621 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:35.585097 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1051961-53f2-4eb7-aea5-bbf29445fddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:35.585988 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051961-53f2-4eb7-aea5-bbf29445fddd service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:35.586268 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051961-53f2-4eb7-aea5-bbf29445fddd service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:35.586540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051961-53f2-4eb7-aea5-bbf29445fddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:35.594757 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1051961-53f2-4eb7-aea5-bbf29445fddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:35.596333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1051961-53f2-4eb7-aea5-bbf29445fddd service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:35.604965 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1419/2816] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:22:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:22:55.642940 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:55.749158 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406a16f-5339-4fb8-9e91-2980f230c965 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:55.755582 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:55.756464 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:55.756740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:55.757036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] PATH_INFO: `/v3/users/1c45060fb3fb4e5eb35305bdc8b737a8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:55.758820 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c45060fb3fb4e5eb35305bdc8b737a8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:55.760958 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:55.812285 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c45060fb3fb4e5eb35305bdc8b737a8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:55.819211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c45060fb3fb4e5eb35305bdc8b737a8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:55.827737 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c45060fb3fb4e5eb35305bdc8b737a8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:55.828369 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c45060fb3fb4e5eb35305bdc8b737a8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:55.829042 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c45060fb3fb4e5eb35305bdc8b737a8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:55.846520 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1398/2817] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:55 2022] DELETE /identity/v3/users/1c45060fb3fb4e5eb35305bdc8b737a8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:55.851286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21377b-b24d-4405-8385-a417d473f472 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:55.851818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21377b-b24d-4405-8385-a417d473f472 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:55.851818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21377b-b24d-4405-8385-a417d473f472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:55.899916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-da21377b-b24d-4405-8385-a417d473f472 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:55.901264 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-da21377b-b24d-4405-8385-a417d473f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:55.959733 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1420/2818] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:55.970497 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:55.972172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:56.070283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca901a22-a28a-4590-b5dd-1dd3caa69340 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.075485 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5a409-e09d-4ab7-a10d-0a067b6f2b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.076137 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5a409-e09d-4ab7-a10d-0a067b6f2b24 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.076412 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5a409-e09d-4ab7-a10d-0a067b6f2b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.076680 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5a409-e09d-4ab7-a10d-0a067b6f2b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.088448 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5a409-e09d-4ab7-a10d-0a067b6f2b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.089951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5a409-e09d-4ab7-a10d-0a067b6f2b24 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.099855 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1399/2819] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:56.382653 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21377b-b24d-4405-8385-a417d473f472 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:56.384596 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-da21377b-b24d-4405-8385-a417d473f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:56.404250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21377b-b24d-4405-8385-a417d473f472 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.410162 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.411211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.411552 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.411891 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] PATH_INFO: `/v3/projects/e2ec3d4c8c9a43bf8ac734caff755c5e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.413443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ec3d4c8c9a43bf8ac734caff755c5e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.415284 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.469220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ec3d4c8c9a43bf8ac734caff755c5e', 'request_id': 'req-d77b8f3a-5c01-4e08-b9f5-21774c697555'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:56.477768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ec3d4c8c9a43bf8ac734caff755c5e', 'request_id': 'req-d77b8f3a-5c01-4e08-b9f5-21774c697555'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:56.483561 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ec3d4c8c9a43bf8ac734caff755c5e', 'request_id': 'req-d77b8f3a-5c01-4e08-b9f5-21774c697555'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:56.494191 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] The token cache is being invalidate because project e2ec3d4c8c9a43bf8ac734caff755c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:56.494468 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:56.495081 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d77b8f3a-5c01-4e08-b9f5-21774c697555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:56.496866 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1421/2820] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:56 2022] DELETE /identity/v3/projects/e2ec3d4c8c9a43bf8ac734caff755c5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:56.501924 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.502211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.502488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.556208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:56.557482 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:56.628785 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1400/2821] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:56.637690 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.637974 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.638252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.662285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:56.664860 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:56.678275 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1422/2822] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:56.683628 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:56.695210 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc455-4ccf-4117-b14a-631682df97e1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.700727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.701444 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.701722 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.701998 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.702730 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:22:56.703038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.704684 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.717494 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1401/2823] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:22:56.722898 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:56.735379 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4d96f-7a52-49a7-ac1b-0397b59c5da8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.741238 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.741899 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.742176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.742446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.743165 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.745188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.777617 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1423/2824] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:56 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:56.783211 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:56.796999 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ba54-29bc-43fe-bd10-45c3a5019642 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.866842 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.867516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.868002 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.868491 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.869360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.871918 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.897626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1402/2825] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:56 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:56.903557 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:56.920533 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479614-7703-4e6e-abbb-9e0615010505 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.929011 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.929821 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.930236 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.930731 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.932017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.934408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.948066 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1424/2826] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:56.954351 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:56.969642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdab99-46ff-4d9f-9558-306c171953e7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:56.976371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc816ca-61de-4fd7-9bbf-f277d27b349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:56.977273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc816ca-61de-4fd7-9bbf-f277d27b349a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:56.977639 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc816ca-61de-4fd7-9bbf-f277d27b349a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:56.977930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc816ca-61de-4fd7-9bbf-f277d27b349a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:56.979617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc816ca-61de-4fd7-9bbf-f277d27b349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:56.981223 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc816ca-61de-4fd7-9bbf-f277d27b349a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:56.992062 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1403/2827] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:56.998490 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:57.012947 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc5486-eb0a-4bfa-b0e0-d602ab900c90 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:57.019540 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:57.020434 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:57.021024 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:57.021438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] PATH_INFO: `/v3/projects/031eddf61a20401f87731259d16c9df8/users/79b4c8825bd246d9b305d650acdd03ee/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:57.043861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] RBAC: Authorizing `identity:create_grant(project_id=031eddf61a20401f87731259d16c9df8, user_id=79b4c8825bd246d9b305d650acdd03ee, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:57.047179 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:57.069991 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1425/2828] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:56 2022] PUT /identity/v3/projects/031eddf61a20401f87731259d16c9df8/users/79b4c8825bd246d9b305d650acdd03ee/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:57.081938 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:57.082222 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:57.082493 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:57.120306 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] MFA Rules not processed for user `79b4c8825bd246d9b305d650acdd03ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:57.121727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:57.202547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1404/2829] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:57.214864 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:57.216867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:57.283216 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a33fd-6cc7-48e3-89dc-c420328e744e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:57.288340 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023fdc-3331-4059-ae35-ca007f693e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:57.289214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023fdc-3331-4059-ae35-ca007f693e4f service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:57.289497 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023fdc-3331-4059-ae35-ca007f693e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:57.289772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023fdc-3331-4059-ae35-ca007f693e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:57.299732 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023fdc-3331-4059-ae35-ca007f693e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:57.301231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023fdc-3331-4059-ae35-ca007f693e4f service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:57.311267 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1426/2830] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:57.344856 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:57.420026 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6261d1-a333-449a-a63e-06bb2ebca770 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:57.430430 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:57.432156 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:57.432544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:57.432959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] PATH_INFO: `/v3/users/79b4c8825bd246d9b305d650acdd03ee` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:57.434340 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b4c8825bd246d9b305d650acdd03ee)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:57.436367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:57.493516 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b4c8825bd246d9b305d650acdd03ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:57.502144 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b4c8825bd246d9b305d650acdd03ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:57.512250 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b4c8825bd246d9b305d650acdd03ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:57.512965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b4c8825bd246d9b305d650acdd03ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:57.513598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b4c8825bd246d9b305d650acdd03ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:57.544049 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1405/2831] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:22:57 2022] DELETE /identity/v3/users/79b4c8825bd246d9b305d650acdd03ee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:22:57.548590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:57.549071 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:57.549442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:57.569935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:57.571252 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:57.642204 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1427/2832] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:22:57.653544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:57.658045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:57.726101 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56991e-a45c-4dae-8023-e12bee8f38d3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:57.732346 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4812e8-1c6c-437d-98ca-78280e137314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:57.733686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4812e8-1c6c-437d-98ca-78280e137314 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:57.734152 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4812e8-1c6c-437d-98ca-78280e137314 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:57.734598 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4812e8-1c6c-437d-98ca-78280e137314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:57.744825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4812e8-1c6c-437d-98ca-78280e137314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:57.746654 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4812e8-1c6c-437d-98ca-78280e137314 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:57.756585 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1406/2833] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:22:58.039335 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.040932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:58.054249 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdc59a-f1b0-42e3-8c99-ffc63a4ebf73 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.063871 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.064686 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.065050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.065324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] PATH_INFO: `/v3/projects/031eddf61a20401f87731259d16c9df8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.066666 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031eddf61a20401f87731259d16c9df8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.068772 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.124156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031eddf61a20401f87731259d16c9df8', 'request_id': 'req-8231b9fa-08e9-4014-aa5f-e21a3a45c791'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:58.133975 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031eddf61a20401f87731259d16c9df8', 'request_id': 'req-8231b9fa-08e9-4014-aa5f-e21a3a45c791'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:58.139823 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031eddf61a20401f87731259d16c9df8', 'request_id': 'req-8231b9fa-08e9-4014-aa5f-e21a3a45c791'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:58.150915 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] The token cache is being invalidate because project 031eddf61a20401f87731259d16c9df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:22:58.151197 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:58.151802 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8231b9fa-08e9-4014-aa5f-e21a3a45c791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:22:58.153489 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1428/2834] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:22:58 2022] DELETE /identity/v3/projects/031eddf61a20401f87731259d16c9df8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:22:58.158888 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.159093 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.159378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.178339 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:58.179552 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:58.243441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1407/2835] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:58.253364 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.253630 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.253924 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.273633 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:58.274861 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:58.283909 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1429/2836] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:58.288531 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.298715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e59a1-6415-414f-9804-38b5ccefb8d3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.305123 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.305758 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.306028 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.306296 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.307010 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:22:58.307308 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.309070 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.323294 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1408/2837] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 04 06:22:58.328717 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.342679 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45736c9e-13c2-471f-967f-361b29a06d17 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.348286 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.348996 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.349280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.349555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.350255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.352218 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.382849 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1430/2838] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:22:58 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:58.387870 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.400415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b17f1-4886-4e54-af82-1d94d561b14e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.473175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.473749 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.474033 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.474301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.474986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.476929 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.501688 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1409/2839] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:22:58 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:22:58.506080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.517357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43fd70-425b-4a2d-8954-74476a7e09eb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.522569 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.523231 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.523510 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.523786 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.524524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.526167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.537250 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1431/2840] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:58.541508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.551857 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab72325-22cb-46c7-8831-af1243a9486e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.557151 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a56f74-af03-48e9-90b7-bb2a5be2b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.557901 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56f74-af03-48e9-90b7-bb2a5be2b51d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.558184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56f74-af03-48e9-90b7-bb2a5be2b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.558514 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56f74-af03-48e9-90b7-bb2a5be2b51d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.559278 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a56f74-af03-48e9-90b7-bb2a5be2b51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.560860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a56f74-af03-48e9-90b7-bb2a5be2b51d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.570741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1410/2841] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:22:58.575203 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.585237 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98f66c-80c4-4512-96dc-5df6ec824f5a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.590740 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.591615 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.591894 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.592167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] PATH_INFO: `/v3/projects/e54d4eb4676d4fab8ab6e2958b672556/users/ffc941f5a6bb4448868a2db063dd1f9d/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.608409 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54d4eb4676d4fab8ab6e2958b672556, user_id=ffc941f5a6bb4448868a2db063dd1f9d, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.611063 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.627897 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1432/2842] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:22:58 2022] PUT /identity/v3/projects/e54d4eb4676d4fab8ab6e2958b672556/users/ffc941f5a6bb4448868a2db063dd1f9d/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:22:58.639067 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0267-750a-4efd-8475-25f0950fa3f7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.639338 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0267-750a-4efd-8475-25f0950fa3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.639626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0267-750a-4efd-8475-25f0950fa3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.670228 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-981b0267-750a-4efd-8475-25f0950fa3f7 None None] MFA Rules not processed for user `ffc941f5a6bb4448868a2db063dd1f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:22:58.671432 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-981b0267-750a-4efd-8475-25f0950fa3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:58.737930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1411/2843] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:22:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:22:58.748911 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:22:58.750722 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:22:58.809610 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208c01-64a0-4ddf-b62d-dde7faff71d4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:22:58.813506 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:22:58.814164 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:22:58.814441 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:22:58.814713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:22:58.824172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:22:58.825750 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:22:58.834979 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1433/2844] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:22:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:00.192032 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:00.192544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:00.192544 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:00.211919 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] MFA Rules not processed for user `ffc941f5a6bb4448868a2db063dd1f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:00.213096 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:00.221332 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1412/2845] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:23:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:11.523600 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:11.525314 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:11.583945 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653490e7-584a-4566-b106-bff66e87952d service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:11.588035 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:11.588697 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:11.589007 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:11.589285 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:11.591353 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:11.655680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:11.657804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:11.668815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1434/2846] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:23:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:13.370199 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:13.371863 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:13.452561 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0d35-f535-49c6-aa6a-5c1c22082f4d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:13.458175 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:13.458839 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:13.459138 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:13.459404 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:13.461889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:13.476148 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:13.478095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df210e2-9819-40e2-9f40-3818e3d71c54 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:13.491905 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1413/2847] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:23:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:14.530639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:14.532053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:14.647616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7457a-03a7-41a5-b4e7-416583355c34 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:14.659027 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:14.659845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:14.661009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:14.661391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:14.664998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:14.677601 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:14.679307 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:14.690293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1435/2848] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:23:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:15.313886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1d2d-6846-4c61-a0ee-010f45a16621 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:15.314379 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1d2d-6846-4c61-a0ee-010f45a16621 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:15.314483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1d2d-6846-4c61-a0ee-010f45a16621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:15.359115 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e16e1d2d-6846-4c61-a0ee-010f45a16621 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:15.361812 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e16e1d2d-6846-4c61-a0ee-010f45a16621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:15.434466 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1414/2849] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:23:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:15.447845 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:15.449558 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:15.558895 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e177fd3-cec5-492e-aa2a-d0cafe58beed service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:15.567385 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:15.568183 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:15.568654 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:15.569110 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:15.601169 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:15.603382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:15.612433 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1436/2850] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:23:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:23:16.162537 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5366d-9145-4b79-8730-b90ae4e8b632 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:16.162826 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5366d-9145-4b79-8730-b90ae4e8b632 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:16.163122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5366d-9145-4b79-8730-b90ae4e8b632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:16.182616 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b0e5366d-9145-4b79-8730-b90ae4e8b632 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:16.183821 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b0e5366d-9145-4b79-8730-b90ae4e8b632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:16.192519 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1415/2851] 10.222.0.30 () {58 vars in 967 bytes} [Mon Apr 4 06:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:16.205963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:16.217537 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abb99c-c721-41cf-85ff-3f8ff360ea03 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:16.222716 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:16.223357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:16.223635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:16.223916 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:16.233429 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:16.235017 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:16.243038 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1437/2852] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:23:16.450776 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce94c78-824d-418f-a4e8-a8107f71cfa2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:16.451283 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce94c78-824d-418f-a4e8-a8107f71cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:16.451387 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce94c78-824d-418f-a4e8-a8107f71cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:16.472109 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8ce94c78-824d-418f-a4e8-a8107f71cfa2 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:16.473374 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8ce94c78-824d-418f-a4e8-a8107f71cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:16.480686 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1416/2853] 10.222.0.30 () {58 vars in 1009 bytes} [Mon Apr 4 06:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:16.493316 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:16.503932 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e250b5-7064-42f0-9ca6-11b333c8bab6 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:16.509590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:16.510244 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:16.510525 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:16.510803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:16.519452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:16.521122 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:16.529486 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1438/2854] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 04 06:23:16.869330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:16.869626 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:16.869954 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:16.889653 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:16.890786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:16.898401 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1417/2855] 10.222.0.30 () {58 vars in 967 bytes} [Mon Apr 4 06:23:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:16.910726 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:16.921487 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93c2c4-9f2d-4213-acf1-932b51aa3f69 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:16.926859 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0b1c-1d0f-47ee-85a8-ec1022ce931a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:16.927518 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0b1c-1d0f-47ee-85a8-ec1022ce931a service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:16.927800 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0b1c-1d0f-47ee-85a8-ec1022ce931a service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:16.928075 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0b1c-1d0f-47ee-85a8-ec1022ce931a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:16.936935 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0b1c-1d0f-47ee-85a8-ec1022ce931a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:16.938511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0b1c-1d0f-47ee-85a8-ec1022ce931a service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:16.946603 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1439/2856] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:23:19.231192 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:19.297367 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc9f3b-8c54-4fc4-ac01-af14050ad706 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:19.302891 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:19.303770 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:19.304044 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:19.304309 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] PATH_INFO: `/v3/users/ffc941f5a6bb4448868a2db063dd1f9d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:19.305577 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc941f5a6bb4448868a2db063dd1f9d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:19.307487 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:19.356257 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc941f5a6bb4448868a2db063dd1f9d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.367184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc941f5a6bb4448868a2db063dd1f9d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.375110 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc941f5a6bb4448868a2db063dd1f9d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.375822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc941f5a6bb4448868a2db063dd1f9d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.376446 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc941f5a6bb4448868a2db063dd1f9d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.393040 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1418/2857] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:23:19 2022] DELETE /identity/v3/users/ffc941f5a6bb4448868a2db063dd1f9d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:23:19.397585 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:19.398064 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:19.398167 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:19.416188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:19.417399 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:19.475022 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1440/2858] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:19.487201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:19.488878 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:19.552868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eab51-ab57-472d-9ad3-028780c4731c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:19.557759 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450875fe-e7a3-4e98-abae-41e7a7062821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:19.558411 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450875fe-e7a3-4e98-abae-41e7a7062821 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:19.558689 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450875fe-e7a3-4e98-abae-41e7a7062821 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:19.558959 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450875fe-e7a3-4e98-abae-41e7a7062821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:19.569977 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450875fe-e7a3-4e98-abae-41e7a7062821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:19.571421 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450875fe-e7a3-4e98-abae-41e7a7062821 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:19.582889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1419/2859] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:19.765952 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:19.767473 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:19.782121 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fcf2e-4213-47d0-b16a-c980aefbe1b9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:19.788519 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:19.789462 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:19.789578 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:19.789837 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] PATH_INFO: `/v3/projects/e54d4eb4676d4fab8ab6e2958b672556` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:19.791128 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54d4eb4676d4fab8ab6e2958b672556)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:19.793062 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:19.844560 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54d4eb4676d4fab8ab6e2958b672556', 'request_id': 'req-45ad3164-0579-48e9-aee7-d1009c0684e9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.852868 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54d4eb4676d4fab8ab6e2958b672556', 'request_id': 'req-45ad3164-0579-48e9-aee7-d1009c0684e9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.858795 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54d4eb4676d4fab8ab6e2958b672556', 'request_id': 'req-45ad3164-0579-48e9-aee7-d1009c0684e9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.870443 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] The token cache is being invalidate because project e54d4eb4676d4fab8ab6e2958b672556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:23:19.870729 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.871470 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-45ad3164-0579-48e9-aee7-d1009c0684e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:19.873403 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1441/2860] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:23:19 2022] DELETE /identity/v3/projects/e54d4eb4676d4fab8ab6e2958b672556 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:23:19.878483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:19.878766 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:19.879035 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:19.898004 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:19.899197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:19.961832 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1420/2861] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:19.972090 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:19.972380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:19.972658 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:19.992333 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:19.993616 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:20.002918 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1442/2862] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:20.009057 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.022437 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0b5cf-955d-4181-979e-558fe68f35d7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.031435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.032100 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.032371 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.032634 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.033394 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 04 06:23:20.033692 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.035303 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.048881 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1421/2863] 10.222.0.30 () {58 vars in 1152 bytes} [Mon Apr 4 06:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 04 06:23:20.053524 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.063651 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a7bd1-2531-469c-97dd-3d4687527189 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.069682 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.070367 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.070639 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.070922 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.071601 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.073567 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.104188 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1443/2864] 10.222.0.30 () {60 vars in 1152 bytes} [Mon Apr 4 06:23:20 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:23:20.110859 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.121784 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89167ce-0e1b-4861-90db-23ba02328332 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.180631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.181449 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.181789 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.182170 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.182898 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.185249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.206527 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1422/2865] 10.222.0.30 () {60 vars in 1143 bytes} [Mon Apr 4 06:23:20 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 04 06:23:20.210555 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.221009 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42a5c4-ae30-44d0-827b-a011a3bde5cb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.225875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.226680 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.226921 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.227211 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.227944 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.229632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.243665 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1444/2866] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:23:20.244984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.255512 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f41d-6c64-4775-9255-cfacf12b3abb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.261950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749ad7e-e57d-47e1-9357-31898b5af4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.262549 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749ad7e-e57d-47e1-9357-31898b5af4bb admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.262899 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749ad7e-e57d-47e1-9357-31898b5af4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.263163 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749ad7e-e57d-47e1-9357-31898b5af4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.263953 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749ad7e-e57d-47e1-9357-31898b5af4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.265740 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749ad7e-e57d-47e1-9357-31898b5af4bb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.277618 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1423/2867] 10.222.0.30 () {58 vars in 1121 bytes} [Mon Apr 4 06:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 04 06:23:20.281998 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.292091 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb301c-e1d5-45e8-a8bd-b215b7dba509 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.297186 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.298120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.298408 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.298673 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] PATH_INFO: `/v3/projects/d3d4cabf8fdb49288998fbc180d76a1c/users/b1bb8220aee2462d9abfa3beb6649480/roles/f434d50ef8824d07bf4d2382f5470115` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.317280 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d4cabf8fdb49288998fbc180d76a1c, user_id=b1bb8220aee2462d9abfa3beb6649480, role_id=f434d50ef8824d07bf4d2382f5470115)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.320278 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.338475 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1445/2868] 10.222.0.30 () {60 vars in 1482 bytes} [Mon Apr 4 06:23:20 2022] PUT /identity/v3/projects/d3d4cabf8fdb49288998fbc180d76a1c/users/b1bb8220aee2462d9abfa3beb6649480/roles/f434d50ef8824d07bf4d2382f5470115 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 04 06:23:20.356095 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.356595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.357292 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.396548 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] MFA Rules not processed for user `b1bb8220aee2462d9abfa3beb6649480`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:20.397830 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:20.464285 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1424/2869] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:23:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:23:20.479942 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:20.482635 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:20.546662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc25f29-0da4-4b5c-bfc5-76f1a84f63ff admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:20.551180 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862690-0337-4094-8d16-ba7c200ee94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:20.551827 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862690-0337-4094-8d16-ba7c200ee94f service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:20.552106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862690-0337-4094-8d16-ba7c200ee94f service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:20.552375 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862690-0337-4094-8d16-ba7c200ee94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:20.561201 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8862690-0337-4094-8d16-ba7c200ee94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:20.562632 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8862690-0337-4094-8d16-ba7c200ee94f service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:20.571295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1446/2870] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:23:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:28.712840 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:28.787783 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf043b7-bdf7-4233-b0e6-877041e03c4f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:28.793385 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:28.794267 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:28.794543 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:28.794806 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] PATH_INFO: `/v3/users/b1bb8220aee2462d9abfa3beb6649480` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:28.796117 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bb8220aee2462d9abfa3beb6649480)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:28.798121 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:28.850172 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bb8220aee2462d9abfa3beb6649480'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:28.858349 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bb8220aee2462d9abfa3beb6649480'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:28.868407 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bb8220aee2462d9abfa3beb6649480'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:28.869201 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bb8220aee2462d9abfa3beb6649480'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:28.869939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bb8220aee2462d9abfa3beb6649480'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:28.888623 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1425/2871] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:23:28 2022] DELETE /identity/v3/users/b1bb8220aee2462d9abfa3beb6649480 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:23:28.893768 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:28.894283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:28.894283 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:28.916036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] MFA Rules not processed for user `0d8085b78f244bdfbf8da4f7668ae4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:23:28.917255 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:28.981368 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1447/2872] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 04 06:23:28.991864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:28.993469 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:29.053505 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c1c0-aebd-4901-bf5d-413fe5000d98 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:29.058113 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6f60-35f0-4eaa-bc8e-3289ce600d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:29.058761 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6f60-35f0-4eaa-bc8e-3289ce600d92 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:29.059036 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6f60-35f0-4eaa-bc8e-3289ce600d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:29.059301 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6f60-35f0-4eaa-bc8e-3289ce600d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:29.069739 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6f60-35f0-4eaa-bc8e-3289ce600d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:29.071206 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6f60-35f0-4eaa-bc8e-3289ce600d92 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:29.081273 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1426/2873] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:23:29.368963 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:23:29.370446 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:23:29.382579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9ea9-db95-41d3-a809-991bf31cd077 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:23:29.388012 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:23:29.388878 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:23:29.389172 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:23:29.389442 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] PATH_INFO: `/v3/projects/d3d4cabf8fdb49288998fbc180d76a1c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:23:29.390652 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d4cabf8fdb49288998fbc180d76a1c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:23:29.392590 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:23:29.441420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d4cabf8fdb49288998fbc180d76a1c', 'request_id': 'req-2f4334c9-0385-4d72-850b-64910e500d5e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:29.449576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d4cabf8fdb49288998fbc180d76a1c', 'request_id': 'req-2f4334c9-0385-4d72-850b-64910e500d5e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:29.455157 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d4cabf8fdb49288998fbc180d76a1c', 'request_id': 'req-2f4334c9-0385-4d72-850b-64910e500d5e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:29.465896 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] The token cache is being invalidate because project d3d4cabf8fdb49288998fbc180d76a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:23:29.466187 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:29.466804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:23:29.468377 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1448/2874] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:23:29 2022] DELETE /identity/v3/projects/d3d4cabf8fdb49288998fbc180d76a1c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:24:52.664868 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808e206-7e06-461f-9930-802c28cda131 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:24:52.665408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808e206-7e06-461f-9930-802c28cda131 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:24:52.665631 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808e206-7e06-461f-9930-802c28cda131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:24:52.684825 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d808e206-7e06-461f-9930-802c28cda131 None None] MFA Rules not processed for user `f9dfd20af1874415be353e22a59ecbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:24:52.685979 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d808e206-7e06-461f-9930-802c28cda131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:24:52.744624 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1427/2875] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:24:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:24:53.078006 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:24:53.079818 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:24:53.143112 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4334c9-0385-4d72-850b-64910e500d5e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:24:53.147383 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:24:53.148029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:24:53.148306 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:24:53.148579 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:24:53.150494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:24:53.160224 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:24:53.161834 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:24:53.169867 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1449/2876] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:24:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:25:03.134854 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808e206-7e06-461f-9930-802c28cda131 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:03.150965 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808e206-7e06-461f-9930-802c28cda131 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:03.156964 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:03.157950 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:03.158330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:03.158721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:03.161715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:03.267822 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:03.270243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98e4c2-c864-4aec-a558-1e641d25c7f7 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:03.299377 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1428/2877] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:25:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:25:37.805028 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:37.814553 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdacb4-bff6-411f-a862-3ea9ecc87dea service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:37.819214 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:37.819882 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:37.820156 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:37.820426 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:37.822713 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:37.837146 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:37.838588 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:37.850466 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1450/2878] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:25:40.204214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:40.204712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:40.205072 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:40.257184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] MFA Rules not processed for user `2237e08b136e422aa924acb345f90b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:25:40.259342 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:40.335234 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1429/2879] 10.222.0.30 () {58 vars in 967 bytes} [Mon Apr 4 06:25:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:25:40.389691 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:40.391934 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:40.480692 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f8c7-b3c5-4103-8865-c546a300e7cf service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:40.486521 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9357bd3de9b4dbebed74a1dcd6420c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:40.487213 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:40.487494 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:40.487761 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:40.497123 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:40.499036 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:40.508176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1451/2880] 10.222.0.30 () {60 vars in 1384 bytes} [Mon Apr 4 06:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 04 06:25:47.557975 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:47.559556 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:47.632738 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25c8c-8299-49d6-84a1-cedfbd871156 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:47.638649 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:47.639545 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:47.639819 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:47.640102 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] PATH_INFO: `/v3/users/b524e1039aef4893bc4cf03ef97b4cdd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:47.641425 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b524e1039aef4893bc4cf03ef97b4cdd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:47.643435 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:47.707413 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b524e1039aef4893bc4cf03ef97b4cdd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:47.714701 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b524e1039aef4893bc4cf03ef97b4cdd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:47.723596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b524e1039aef4893bc4cf03ef97b4cdd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:47.724217 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b524e1039aef4893bc4cf03ef97b4cdd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:47.724860 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b524e1039aef4893bc4cf03ef97b4cdd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:47.742038 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1430/2881] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:25:47 2022] DELETE /identity/v3/users/b524e1039aef4893bc4cf03ef97b4cdd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:25:47.925068 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:47.935712 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a221b-d8c8-493e-8e01-e49bb94d7670 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:47.995145 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:47.996476 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:47.997220 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:47.997498 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] PATH_INFO: `/v3/projects/9ff00fa7f72d4523b6d26ddda865bbcf` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:48.003120 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff00fa7f72d4523b6d26ddda865bbcf)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:48.006576 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:48.059875 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff00fa7f72d4523b6d26ddda865bbcf', 'request_id': 'req-543d3e63-7210-45c6-aeff-4d8296e8a9cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.067380 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff00fa7f72d4523b6d26ddda865bbcf', 'request_id': 'req-543d3e63-7210-45c6-aeff-4d8296e8a9cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.073637 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff00fa7f72d4523b6d26ddda865bbcf', 'request_id': 'req-543d3e63-7210-45c6-aeff-4d8296e8a9cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.086668 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] The token cache is being invalidate because project 9ff00fa7f72d4523b6d26ddda865bbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:25:48.087096 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.088060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.090184 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1452/2882] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:25:47 2022] DELETE /identity/v3/projects/9ff00fa7f72d4523b6d26ddda865bbcf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:25:48.095595 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:48.097299 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:48.111330 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7cc21-1189-4296-b733-5a9e3c94ff2f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:48.166849 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:48.167712 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:48.167983 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:48.168251 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] PATH_INFO: `/v3/users/1473ec693c424f958d607b8c66706889` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:48.169472 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1473ec693c424f958d607b8c66706889)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:48.171442 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:48.215980 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1473ec693c424f958d607b8c66706889'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.222948 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1473ec693c424f958d607b8c66706889'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.232716 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1473ec693c424f958d607b8c66706889'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.233542 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1473ec693c424f958d607b8c66706889'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.234184 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1473ec693c424f958d607b8c66706889'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.252027 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1431/2883] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:25:48 2022] DELETE /identity/v3/users/1473ec693c424f958d607b8c66706889 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:25:48.438293 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:25:48.439804 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:25:48.453320 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d3e63-7210-45c6-aeff-4d8296e8a9cb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:25:48.521324 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:25:48.522572 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:25:48.522930 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:25:48.523205 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] PATH_INFO: `/v3/projects/12a4659336394c38b35c1d410e48e51a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:25:48.524808 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a4659336394c38b35c1d410e48e51a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:25:48.527815 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:25:48.575581 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a4659336394c38b35c1d410e48e51a', 'request_id': 'req-2f0abc3f-78cc-434c-a628-178c9f0e89fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.585067 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a4659336394c38b35c1d410e48e51a', 'request_id': 'req-2f0abc3f-78cc-434c-a628-178c9f0e89fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.593032 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a4659336394c38b35c1d410e48e51a', 'request_id': 'req-2f0abc3f-78cc-434c-a628-178c9f0e89fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.603681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] The token cache is being invalidate because project 12a4659336394c38b35c1d410e48e51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:25:48.603959 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.604660 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:25:48.606291 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1453/2884] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:25:48 2022] DELETE /identity/v3/projects/12a4659336394c38b35c1d410e48e51a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:26:20.701810 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:26:20.703647 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:26:20.768414 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe278-b297-4977-90b7-f51d5fe4d8c8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:26:20.828951 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:26:20.829866 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:26:20.830195 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:26:20.830488 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:26:20.833727 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:26:20.846139 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:26:20.847608 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d7af-fd14-4b37-9a97-7ff710c6e4c0 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:26:20.856508 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1432/2885] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:26:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:27:02.344398 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:27:02.346106 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:02.432410 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0abc3f-78cc-434c-a628-178c9f0e89fc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:27:02.436687 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0640518ddc4893b20b6d79c80c21ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:27:02.437389 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:27:02.437674 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:27:02.437938 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:27:02.439904 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:02.504309 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:27:02.505801 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:27:02.515233 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1454/2886] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:27:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:27:11.475183 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:27:11.475723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:27:11.475723 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:27:11.494463 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] MFA Rules not processed for user `f9dfd20af1874415be353e22a59ecbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 04 06:27:11.495695 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:11.504045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1433/2887] 10.222.0.30 () {58 vars in 957 bytes} [Mon Apr 4 06:27:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 04 06:27:12.358721 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:27:12.360153 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:12.430289 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc5329-17c7-4e6f-b17b-90034151d021 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:27:12.435176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:27:12.435830 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:27:12.436101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:27:12.436452 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:27:12.438391 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:12.449488 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:27:12.451080 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:27:12.461158 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1455/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:27:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:27:14.914939 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:27:14.917963 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:15.005606 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a28333-8f79-4f49-8aa5-35160b21aa93 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:27:15.012174 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:27:15.012886 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:27:15.013197 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:27:15.013473 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:27:15.015408 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:15.028984 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:27:15.030671 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:27:15.042942 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1434/2889] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:27:26.691053 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:27:26.693000 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:26.709430 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb3b44-8455-4e6b-9034-15404f45930f service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:27:26.714989 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:27:26.715640 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:27:26.715917 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:27:26.716176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:27:26.718889 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:26.742056 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:27:26.744357 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:27:26.756931 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1456/2890] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:27:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:27:29.377429 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:27:29.380022 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:29.399889 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd00127-8160-45d4-9ba3-91d3bc4a105b service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:27:29.407122 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:27:29.408116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:27:29.408547 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:27:29.408978 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:27:29.411786 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:27:29.480715 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:27:29.482208 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:27:29.492274 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1435/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:27:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 04 06:28:21.380382 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:28:21.382424 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:28:21.397438 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068b65-1f10-45fc-8e59-8b88a203f5aa service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:28:21.403029 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:28:21.403662 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:28:21.403939 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:28:21.404206 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:28:21.406058 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:28:21.418176 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:28:21.419760 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:28:21.430060 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1457/2892] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:28:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:29:24.380415 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:29:24.394378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02e12-341d-42be-b9b4-ccd322e47186 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:29:24.400629 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07287811d9ef4e04bd62a665d642b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:29:24.401470 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:29:24.401765 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:29:24.402045 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:29:24.403864 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:29:24.417775 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:29:24.419642 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:29:24.436431 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1436/2893] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:29:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:29:37.111925 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:29:37.122646 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41e94c-3757-41fb-af5e-f48866f3de66 service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:29:37.126992 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ada2f7acb1349e38b96dfbda5546101', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:29:37.127628 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:29:37.127902 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:29:37.128166 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:29:37.130239 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:29:37.195833 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:29:37.198229 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:29:37.207865 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1458/2894] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 04 06:29:43.358506 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:29:43.363030 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:29:43.376378 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9717f-251b-4cd7-86d6-a12abe331183 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:29:43.380986 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:29:43.381865 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:29:43.382146 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:29:43.382420 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] PATH_INFO: `/v3/users/f9dfd20af1874415be353e22a59ecbfc` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:29:43.383962 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dfd20af1874415be353e22a59ecbfc)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:29:43.385930 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:29:43.447171 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dfd20af1874415be353e22a59ecbfc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.454227 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dfd20af1874415be353e22a59ecbfc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.463502 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dfd20af1874415be353e22a59ecbfc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.464188 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dfd20af1874415be353e22a59ecbfc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.465025 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dfd20af1874415be353e22a59ecbfc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.483617 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1437/2895] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:29:43 2022] DELETE /identity/v3/users/f9dfd20af1874415be353e22a59ecbfc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:29:43.670743 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:29:43.684564 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9e8e0-1024-47f7-878a-632f53547a0f service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:29:43.757129 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:29:43.758803 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:29:43.759226 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:29:43.759642 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] PATH_INFO: `/v3/projects/68988ae34214443380cdb8f4c7433802` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:29:43.761676 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68988ae34214443380cdb8f4c7433802)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:29:43.764738 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:29:43.822609 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68988ae34214443380cdb8f4c7433802', 'request_id': 'req-67ddba7a-cde1-4faf-9ec8-3072dadf5010'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.831530 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68988ae34214443380cdb8f4c7433802', 'request_id': 'req-67ddba7a-cde1-4faf-9ec8-3072dadf5010'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.837681 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68988ae34214443380cdb8f4c7433802', 'request_id': 'req-67ddba7a-cde1-4faf-9ec8-3072dadf5010'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.850406 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] The token cache is being invalidate because project 68988ae34214443380cdb8f4c7433802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:29:43.850783 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.851482 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.854511 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1459/2896] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:29:43 2022] DELETE /identity/v3/projects/68988ae34214443380cdb8f4c7433802 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:29:43.859433 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:29:43.860441 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:29:43.873827 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd9d22-be72-4588-9186-ff0585eadb6d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:29:43.932997 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:29:43.933916 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:29:43.934214 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:29:43.934483 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] PATH_INFO: `/v3/users/7e2bfa491d4d48fdada0c7b1949bfcd7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:29:43.935734 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2bfa491d4d48fdada0c7b1949bfcd7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:29:43.937719 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:29:43.988741 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2bfa491d4d48fdada0c7b1949bfcd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:43.995630 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2bfa491d4d48fdada0c7b1949bfcd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.002955 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2bfa491d4d48fdada0c7b1949bfcd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.003721 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2bfa491d4d48fdada0c7b1949bfcd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.004388 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2bfa491d4d48fdada0c7b1949bfcd7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.023269 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1438/2897] 10.222.0.30 () {58 vars in 1223 bytes} [Mon Apr 4 06:29:43 2022] DELETE /identity/v3/users/7e2bfa491d4d48fdada0c7b1949bfcd7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:29:44.216101 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:29:44.217611 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:29:44.232338 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddba7a-cde1-4faf-9ec8-3072dadf5010 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:29:44.289892 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d8085b78f244bdfbf8da4f7668ae4fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f13bc56bb56c4dff9db8451a514a4fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:29:44.290747 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:29:44.291023 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:29:44.291295 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] PATH_INFO: `/v3/projects/b579d521e0cf45ebab46a26cd6aed8a7` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:29:44.292577 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b579d521e0cf45ebab46a26cd6aed8a7)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:29:44.294507 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:29:44.340420 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b579d521e0cf45ebab46a26cd6aed8a7', 'request_id': 'req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.349325 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b579d521e0cf45ebab46a26cd6aed8a7', 'request_id': 'req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.355050 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b579d521e0cf45ebab46a26cd6aed8a7', 'request_id': 'req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.366404 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] The token cache is being invalidate because project b579d521e0cf45ebab46a26cd6aed8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 04 06:29:44.366683 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.367326 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2b905a64-1e77-4cc8-89d7-d999ff5d8a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 04 06:29:44.368928 dv-cinder-834448-2-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1460/2898] 10.222.0.30 () {58 vars in 1232 bytes} [Mon Apr 4 06:29:44 2022] DELETE /identity/v3/projects/b579d521e0cf45ebab46a26cd6aed8a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 04 06:33:26.391655 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 04 06:33:26.393243 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:33:26.550946 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb44218-4d7c-4cf0-a6ee-d5e19a763f22 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 04 06:33:26.621116 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dda594dc09349198b35cff3bc47c0a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7ba26b66ef4d278a11b80b7b2d448e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 04 06:33:26.621808 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 04 06:33:26.622089 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 04 06:33:26.622360 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 04 06:33:26.624596 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 04 06:33:26.637662 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 04 06:33:26.639249 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94f8d3-431c-4970-b50d-aadc215625eb service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 04 06:33:26.649581 dv-cinder-834448-2-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1439/2899] 10.222.0.30 () {60 vars in 1365 bytes} [Mon Apr 4 06:33:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)